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20  Abstract 
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where  RKn'***'RMM  are  the  respective  ranks  of  X„,,...,x  : 


ni':::"w 

CN1'***'CNN  are  lcnown  constants,  and  • • • • * ajj(N)  are  score 

generated  by  a known  function  cp(t) , 0 < t < 1 in  a specified 
manner.  Asymptotic  normality  of  SN  is  obtained  by  expressing 
it  as  the  stochastic  integral  of  suitably  defined  empirical 

I 

and  weighted  empirical  processes,  and  using  techniques  of  con- 
vergence of  stochastic  processes  and  reproducing  Kernel 
Hilbert  Spaces. 

An  alternative  approach  to  the  same  problem  is  provided 
by  using  stability  results  from  classical  probability  theory. 

A multivariate  extension  is  also  given. 

^The  phenomenon  of  Gaussian  noise  is  examined  by  viewing 
it  as  the  limiting  action  of  a sequence  of  disturbances  caused 
by  finitely  many  random  variables  acting  on  a certain  func- 
tion space.  A central  limit  theorem  for  white  noise  is  proved 
A connection  between  such  noise  phenomenon  and  the  asymptotic 
behavior  of  certain  rank  statistics  is  exposed. 
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INTRODUCTION  : 

This  paper  is  motivated  by  the  desire  to  extend  methods 
of  Stochastic  Processes  to  problems  of  the  regression  type 
encountered  in  Nonparametric  Statistics,  under  a large  class 
of  alternatives.  A brief  discription  of  the  evolution  of 
the  problem  is  given  below. 

In  1958,  Chernoff  and  Savage  published  their  basic  paper 
on  the  asymptotic  normality  of  certain  nonparametric  statistics 
which  stimulated  a great  deal  of  research  activity  in  the 
area.  In  1968,  Pyke  and  Shorack  obtained  a proof  of  the 
Chernoff-Savage  theorem  by  studying  the  limiting  behavior  of 
an  empirical  process.  Subsequent  to  their  work,  although 
much  work  has  been  done  in  the  area  of  stochastic  processes 
which  arise  in  Statistics,  problems  of  the  regression  type 
have  for  the  most  part  remained  outside  the  purview  of  such 
methods.  The  method  of  attack  for  such  problems  has  so  far 
been  along  the  lines  of  Hcijek  (1961,  1968),  Hoeffding  (1973), 
Puri  and  Sen  (1969) , Dupac  and  H&jek  (1969) , to  name  a 
few.  The  most  general  results  in  this  direction  are  to  be 
found  in  Hajek  (1968). 

In  this  paper,  theorems  of  the  type  proved  in  H&jek  (1968) 
are  proved  by  methods  of  Stochastic  Processes.  During  the 
course  of  the  study  it  was  found  that  existing  techniques  of 
weak  convergence  of  stochastic  porcesses,  such  as  for  instance 
found  in  Pyke  and  Shorack  (1968)  or  in  Billingsley  (1968)  lead 
to  certain  insuperable  technical  problems.  The  classical 
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weak  convergence  techniques  for  such  problems  can  briefly  be 
described  as  follows: 

Suppose  it  is  required  to  find  the  limiting  distribution 
of  a functional  f(X^,...,Xg)  of  observations  X1,...,XN  . 
First,  a suitable  empirical  process  X^t)  based  on  the 
observations  X^,,.,,XN  is  defined.  Then,  conditions  for 
convergence  of  X^t)  to  another  (usually  Gaussian)  process 
X (t)  are  obtained.  Then  with  some  continuity  restrictions 
on  the  functional  f , the  limiting  distribution  of  f(Xj.(t)) 
is  the  same  as  the  distribution  of  the  random  variable 
f (X(t))  . Convergence  of  X^t)  to  X(t)  involves  two 
problems.  First  of  which  is  the  usually  simpler  problem  of 
establishing  the  convergence  of  the  finite  dimensional  dist- 
ributions of  Xjj(t)  to  those  of  X(t)  . Second,  to  obtain 
certain  restrictions  on  the  sample  path  fluctuations  of 
X^(t)  . If  the  number  of  different  distributions  involved 
becomes  large,  as  it  does  in  the  problem  considered  in  this 
paper,  any  analysis  of  the  sample  paths  becomes  extremely 
involved. 

In  view  of  this  last  difficulty,  it  was  found  necessary 
to  develop  a technique  based  on  the  second  order  properties 
of  empirical  processes,  thereby  circumventing  the  need  for 
sample  path  analysis  entailed  by  the  classical  weak  convergence 
methods.  This  however  leads  to  technical  difficulties  of  a 
different  kind  in  that  certain  non-random  estimates  have  to 
be  obtained  for  the  remainder  terms.  During  the  course  of 
estimating  these  remainder  terms,  it  was  found  that  a fairly 
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simple  proof  of  the  asymptotic  normality  of  Hajek  type 
statistic  could  be  given  along  the  lines  of  the  original 
proof  of  the  Cherno^f-Savage  theorem.  This  proof  is  given 
in  Chapter  II. 

In  Chapter  I,  the  second  order  stochastic  integral  is 
defined  and  conditions  for  the  existence  of  such  an  integral 
are  proved.  Next  the  empirical  and  the  weighted  empirical 
process  are  defined  and  their  reproducing  kernels  found.  Then 
criteria  for  second  order  convergence  of  these  processes 
to  Gaussian  processes  are  obtained.  Then  variance  inequalities 
are  obtained  for  stochastic  integrals  of  these  processes. 

These  results  are  in  turn  used  to  obtain  the  asymptotic 
distribution  of  a simple  linear  rank  statistic. 

In  Chapter  II , a different  proof  is  given  for  the 
asymptotic  distribution  of  such  a statistic.  Also  the 
remainder  terms  are  estimated. 

In  Chapter  III,  a multivariante  extension  is  given. 

It  is  an  interesting  fact  that  stochastic  integrals  of 
the  type  considered  here  also  appear  in  an  entirely  different 
context  in  E.  Parzen's  pioneering  work  on  Time  Series  Analysis. 
But  the  kernels  found  here  and  the  Hilbert  spaces  which  they 
span,  apart  from  being  useful  are  also  of  independent  interest. 
In  Chapter  I,  extensive  use  is  made  of  the  very  elegant 
exposition  of  second  order  properties  of  stochastic  processes 
given  in  Lofeve  (1963) . Some  very  interesting  results  con- 
cerning convergence  in  distribution  of  stochastic  integrals 


can  be  found  in  a paper  by  M.  Brown  (1970) 
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In  Chapter  IV,  a classification  and  properties  of  noise 
phenomenon  caused  by  finitely  many  random  variables  as  well 
as  their  convergence  to  Gaussian  noise  are  given.  Further 
a relationship  between  noise  phenomenon  and  the  distributions 
of  rank  statistics  is  exposed. 
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CHAPTER  I 

Second  Order  Approach  to  the  Limiting 
Distribution  of  Simple  Linear  Rank  Statistics: 

1.1  Preliminaries:  Let  be  a sequence  of 

independent  variables  with  the  corresponding  continuous 

distribution  functions  F.,. , . . . , F._.  . Let  R„.  be  the  rank 

N l NN  Nl 

°f  among  ^i'***'*^  • 

i.e.  RNi  = (Number  of  SX^)  ; j = 1,  ...,N  . 

) 

Consider  a simple  linear  rank  statistic  defined  by 
N 

(1.1.1)  SH  * JcNi  cp  (^1.) 

where 

CN1'***,CNN  are  known  constants  and 
cp  : (0,1)  -*  R is  a known  function. 

Statistics  of  this  type  play  a very  important  role  in 
nonparametric  theory;  the  Wilcoxin  and  the  normal  scores 
statistics  being  the  best  known.  We  are  interested  in  the 
limiting  normality  of  SN  . Hajek  [12]  has  obtained  the 
limiting  normality  of  SN  under  mild  conditions  on  cp  . 

But  his  proofs  are  rather  involved  and  we  will  develop  a 
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technique  using  stochastic  integrals  of  suitable  second 

order  processes.  This  approach  is  motivated  by  the  methods 

of  Pyke  and  Shorack  [23]  which  we  will  briefly  describe  below. 

In  the  special  case  when  C.T1  = C„_  = ...  = , 

Nl  N2  Nm  m 


CNr*fl  " *•*  ~ CNN  ' ° ' 


FN1  FN2  FNm  * F and 


FNm+l  * * * FNN  G 


SN  reduces  to  the  Chernof f-Savage  two-sample  case. 

In  this  case,  Pyke  and  Shorack  consider  the  weak  con- 
vergence of  the  process 


1 


(1.1.2)  ^(t)  = JS  (Fm(H^1(t))  - F (H_1  (t) ) ) where 

F_  is  the  empirical  distribution  function  of 
m 

XN^,...,XNm  , Hjj  is  the  empirical  distribution  function 

of  the  entire  sample  and  H = ^ F + G . 

N N 

For  the  more  general  S„  defined  in  (1.1.1)  , it  is 
thus  natural  to  study  the  weighted  empirical  process 

N 

U.1.3)  X^lt)  -PHi(H-l(t))) 

i=l 

where  I (x  * y)  » 1 when  x s y , * 0 when  x > y . 

Unfortunately  this  process  is  much  too  complex  and 
classical  weak  convergence  methods  entail  a detailed  study 
of  the  sample  path  fluctuations  of  the  process.  We  will 
develop  a technique  which  uses  only  the  second  order  properties 
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t 


and  obtain  convergence  of  SN  without  an  analysis  of  sample 
paths. 

The  possibility  of  such  an  approach  was  suggested  by 
Brown  [53  and  Parzen  [18]  . Such  techniques  are  quite  well 
known  in  Times  Series  Analysis  but  have  not  been  used  in 
limiting  distribution  theory.  In  the  next  section,  we  will 
give  the  necessary  definitions  and  results. 

1.2.  Stochastic  Integral  of  a Second  Order  Stochastic  Process 

Let  { X ( t ) s t € T)  be  a real-valued  second  order 
stochastic  process  with  kernel  K(s,t)  = E[X(s)X(t)3  . We 
will  always  assume  that  T is  an  interval  of  real  numbers. 

Let  (Y(t)  : t(T  } be  another  real-valued  second  order 
stochastic  process  with  the  kernel  R(s,t)  = E(Y(s)Y(t))  . 

Let  T = [a,b]  be  an  interval.  We  define  the  second 
order  stochastic  integral  of  X(t)  w.r.  to  Y(t)  as  follows: 
Let  D,p  : a * t^  < . • . < tn_^  ® b . 

Define  the  random  step  function 

N 

T T k-1 

vdiere  XJc  * X(t^)  , . 

Then  the  stochastic  integral  of  X(t)  w.r.  to  Y(t)  is 


(1.2.2)  T X(t)dY(t)  - lim  q.m.  f X-_(t)dX(t) 

T maxlt^  ^^0  JT 

lskaen  * A K 
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if  it  exists;  where  q.m.  stands  for  the  quadratic  mean. 

In  certain  cases  it  might  he  necessary  to  define  it 
as  an  improper  integral  on  (a,b)  • T . 

Then  we  take  T'  * [a, 0]  and  first  define 

(1.2.3)  f X(t)  dY(t)  / a < a < 0 < b 
T 

and  then  define 

(1.2.4)  J X(t)d  Y (t)  * lim  q.m.  f X(t)d  Y(t) 

T a-*a  JT' 

p-»b 

if  it  exists. 

Remark  1 : These  integrals  depend  only  on  the 

"increments"  of  Y(t)  and  not  on  Y(t)  itself. 

Remark  2 t In  most  applications  Y(t)  will  be  a 
non-random  function  g(t)  and  the  kernel  R(s,t)  = g(s)g(t)  . 
In  such  a case  the  stochastic  integral  (1.2.2)  reduces  to 

(1.2.5)  J*Xvt)dg(t) 

T 

Since  X(t)  is  a second  order  process,  it  is  well 
known  that  it  spans  a Hilbert  space  with  K(s,t)  as  its 
reproducing  kernel.  Thus  stochastic  integrals  of  the  type 

(1.2.5)  represent  a linear  functional  on  the  Reproducing 
Kernel  Hilbert  Space  spanned  by  X(t)  or  K(  , ) . See 
Loeve  [17]  or  Parzen  [18]  , for  some  properties  of  such  a 
space.  Also  see  appendix  to  this  chapter. 
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Let  £2(X)  ^e  t*le  Hubert  sPace  spanned  by  X(t)  . 

We  can  identify  £2  (x)  with  a Hilbert  space  as 

follows  s 

Define  a mapping 

(1.2.7)  A : £2(X)  -» 

X(t)  -*  Kfc  where 

Kt(s)  » K(s,t)  , s €T 
We  define  the  inner  product  on  X^  as 

(1.2.8)  (Kt  , Kg)  = (X  (t)  , X (s) ) = E(X(t)  X(s))  =K(s,t) 

(1.2.9)  i.e.  (X(s),X(t))  » (AX(s)  , AX(t))  . 

Since  X(t)  is  dense  in  £2 (X)  (since  X(t)  spans 
£2 (X) ) , we  can  regard  X^  as  being  spanned  by  the  family 
{Kt  : t € T)  . A • by  (1.2.8)  preserves  inner  products, 

|| A]]  - 1 and  is  therefore  continuous. 

In  (1.2.6)  if  we  let 

y • f X(t)  dg(t)  , y 6 £,  (X)  by  definition 
T * 

of  the  stochastic  integral  and 
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(1.2.10)  Ay  * A J X(t)  d g(t)  » f (AX(t))dg(t) 

T T 


J K.dg(t)  whereby, 
T c 


Ay  : T -»  ft  such  that 


(1.2.11)  • (Ay)  (s)  = (J°  K.dg(t))(s)  = J*  K(s,t)dg(t) 

T T 


We  then  have  the  following  interesting  result. 


Proposition  1.2.1  : If  f € , then  f(s)  = 

Proof:  Let  f(s)  = j*  K(s,t)dg(t)  . 

’ T 

Then  f « A f X(t)dg(t) 

' JT 

(f.K)-(Aj*  X(t)dg(t) , AX(s)  ) 

T 


(f*K.) 


(f  X(t)dg(t)  , X(s))  since  A is  inner  product 
JT 


preserving. 

Thus 


(f,Kj  - (f  X(t)dg(t)  , X(s) ) 
T 


E[X(s)  J*  X(t)dg(t)  ] * E J X(s)X(t)dg(t) 
T T 


I E(X(s)X(t))dg(t)  - J*  K(s, t)dg(t) 
T T 


f (s)  which  completes  the  proof. 
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K(  , ) is  called  the  Reproducing  Kernel  of  the  Hilbert 
space  . 

See  Aronszajn  [1]  , for  a comprehensive  discussion  of 
Reproducing  Kernels.  Yosida  [11]  has  a different  approach  but 
a less  detailed  discussion. 

In  general,  the  class  of  processes  Y(t)  (on  functions 
g(t))  for  which  stochastic  integrals  exist  depends  on  the 
process  X(t)  y to  be  more  precise,  it  depends  on  the  corr- 
esponding kernels  as  the  following  theorem  shows. 

Theorem  1.2.2  : Let  the  second  order  stochastic 

process  X(t)  with  the  kernel  K(s,t)  be  independent  of 
the  "increments"  AY(t)  of  the  second  order  stochastic 
process  Y(t)  with  the  kernel  R(s,t)  . Then  the  stochastic 
integral 

T X(t)dY(t)  exists  in  the  sense  of  definition 
(1.2.2)  if  and  only  if 

J*  J*  K(s,t)d,2R(s, t)  exists  as  a Riemann-Stielties  integral. 
Proof  t See  Loeve  [17]  , page  472. 

In  applications,  Y(t)  will  be  a non-random  function 


and  the  preceding  theorem  degenerates  to  the  following 
special  case. 


Corollary  : The  stochastic  integral  !*  x(t)dg(t) 

' T 

exists  if  and  only  if  f f K(s,t)dg(s)dg(t)  exists 

‘T  T 

as  a Riemann-Stieltjes  (perhaps  improper)  integral. 

Proof  : Immediate  noting  that  E(g(s)g(t))  = g(s)g(t) 

and  substituting  in  the  preceding  theorem. 

Remark  : In  general  the  second  order  properties  do 

not  completely  specify  a stochastic  process.  There  is 
however  a very  important  special  case  : namely  when  X(t) 
is  a normal  (Gaussian)  process.  Normal  processes  also 
satisfy  the  following  useful  property  : 


Theorem  1.2.3  : Normality  is  preserved  under  integration 

u.m.  Equivalently,  stochastic  integrals  of  Gaussian 
processes  are  Gaussian  random  variables. 


Proof  : See  Loeve  [17]  . 


1.3.  Second  Order  Properties  of  Weighted  Empirical  Processes 


Let  xni'xn2# * * * ,XNN  ke  independent  random  variables 
with  corresponding  distribution  functions  FNi»FN2"  * * ,pnn 
which  are  continuous. 

We  define 


N 

(l.S.l)  Fk-A  XPHi 

i-1 


Let  CHi'Cii2"*''CNH  be  ^nown  constants 
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We  shall  investigate  the  second  order  properties  of 
the  two  processes. 


(1.3.2)  X^t)  » J CKX^SFj^t)  -F^E^-tt))]} 

t5  KXj.^  F^lt))  -t) 

(1.3.3)  VN(t)  (JiCNtCKX1Ii«F-V))-Fsi(F-1(t))3)  . 


Where  sr  > 0 is  a chosen  normalizing  constant  and  the 
domain  of  each  of  the  processes  is  T * (0,1)  ; i.e. 

0<t<l  . 

X(  ) denotes  the  indicator  function. 

The  process  X^t)  is  of  course  the  well  known 
empirical  process  and  has  been  extensively  studied.  We  will 
only  state  the  needed  results  for  X^t)  and  quote  the 
appropriate  references.  It  is  however  in  the  behaviour  of 
Y^(t)  that  we  are  chiefly  interested.  The  process  YN(t) 
as  well  as  the  process  c(t)  defined  in  (1.1.3)  are 
discussed  by  Koul  and  Koul  and  Staudte  (see,  [15]  and  [16]) 
but  our  approach  is  significantly  different. 


Remark  t We  have  used  - S J,  PNi  , in  place  of 
H in  most  of  the  literature  to  enqphasize  its  dependence 


on  M , which  is  needed  here. 
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Lemma  1.3.1  : E X^t)  * E ( t)  ■ 0 . 


N 

(1.3.4)  EtX^s)  X^t))  = Kjj  ( s , t ) - sAt-i  £ FNi(PN1(8,)FNi(FN1(t) 

i*l 


(1.3.5)  E(Yn(s)  YN(t))  * Rjj (S/ 1) 


4-  . ".CHitFm  (FN1(S)  > *FNi  <FS1  <*>  > -FNi  (F-1  («) ) Fsi  (F-1  (t)  ) } 

SN  1 1 


Proof  : Proof  of  E X^(t)  * 0 ■ E YN(t)  is  obvious. 

Proof  of  (1.3.4)  is  well-known  (see  for  example:  Shorack 
[24]).  We  will  prove  (1.3.5). 

Without  loss  of  generality,  let  s<t  . Let  F“*(s)  ■ u , 
F“^t)  “ v . Hence  u < v . 

a 

Then,  Yn(s)  Y^(t) 

- 4"A.1C»C>0{I  ‘ “>  - Vi  (0)  1 (I  (XNj  ‘ v)  - PNj  (v|  1 

*N  1,3  1 

"4-  * CBi(I(XHi‘U)  -FHi<U)KKXsl*v)  -FNi<v>l 

• N 

+ Xi  5j  C»iC»3  tI<XNi‘U)  ' Vl  (u)  1 (1  <Vj  « v)  - Vi  (V>  > • 

Observe  that  : 

(i)  When  i * j I i u)  is  independent  of 
I (X^  * v)  and  ECK^iu)  "FNi(u)3  * 0 * Hence 
expectation  of  the  second  summation  vanishes. 
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(ii)  E KXj,.*  u)  I(XN.<V)  = PNi(u)  - fn.(u)  afn.(v). 
For  the  cross  product  terms 

E[I  (Xjj.  * u)  Fn.  (v)  + I (Xjj.  s (v) ) Fn.  (u)  ] 

- 2Fn.(u)  Fn.(v)  . 


Combining  (i)  and  (ii)  and  noting  that  u * f”1^)  • 
v • F“*"(t)  , we  have 


which  completes  the  proof. 

Criterion  for  Z ^-convergence : 

Definition  t We  will  say  that  a second  order  stochastic 
process  X^t)  converges  in  £2  to  another  (second  order) 
process  X(t)  if  and  only  if 

HXjjtt)  - X(t)  I|  »{Var  (X^t)  -X(t)}*  -»  0 , it 

as  N -*  +• 

We  then  write 

*N(t)_fl*  X(t)  or 
. . llXjjft)  - X(t)  ||  -♦  0 . 

We  will  now  obtain  conditions  for  f2 “Convergence  of 
Yjj(t)  defined  in  (1.3.3). 


if  and  only  if.  for  each  t € T 


1 


# 


(1.3.6)  lim  E[  E CNiCMi{I(XNi«F"1(t))  -F  . (F^tt))} 

M-M-  SNSM  IstisN  W 

N-t+®  £M  vr«t  /v  ^ /i-»  % « / < 


X(I(XMj‘PM  (t),-PMj(PM  (t,))3 


f(t)  exists. 


Further,  if  (1.3.6)  holds,  the  kernel  of  X(t)  .is 


(1.3.7)  E Y(s)Y(t)  * R(s,t)  = lim  R^U.t)  • 

N-*+« 

In  most  statistical  applications,  we  have  a continuous 
sampling  situation;  that  is  to  say  if  NaM  , we  have 

Xjji  - * xmm  * tThis  is  the  Ha3ek  set  UP>*  Then 

the  above  theorem  simplifies  to  the  following  corollary: 

Corollary  1.3.3  : Let  N a M and  the  sequences  be 

such  that.  ^ ^ , j *M  . The  process  YN(t)  with  the 

kernel  ^(*,0  be  as  defined  earlier.  Then  IN(t)  con- 

vercres  to  a process  Y(t)  with  the  kernel  R(s,t)  ■ lim  R„(s,t) 

N-»+*» 

if  and  only  if. 
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(1.3.8)  lim 


rj:.  VCMiCrHi<PM1(t))  AFKi(FN1(t)) 


M-H—  N M i=l 
N-H-- 


exists  and  is  finite  for  each  t . 


Proof  of  Theorem  1.3.2  : By  Theorem  A,  page  469  of 

Z.A 

Lo^ve,  process  Y„(t) i*Y(t)  if  and  only  if  lim  EYM(t) Y.T(t) 

N M-*+«*  M N 

N-*+» 

exists  and  is  finite  for  each  t . Then  lim  R..(s(t)  =R(s,t) 

N-»+» 

is  the  kernel  of  Y(t)  . 

Since  we  have  made  no  assumptions  about  the  sequences 

and  , no  further  simplification  is  possible. 

Proof  of  Corollary  1.3.3  s Note  that  M t N and  hence 

1 » 

PM1  " FN1'#,"FMM  “ FNM  * BUt  FN  " N.  E.FNi  3nd 
1 M 

PM  " M **  Fnj  could  be  different.  Also  CN^  may  not  equal 
Cj^  and  8^  and  sN  can  be  different. 

In  order  to  simplify  the  notation  we  shall  write 
F'^t)  - u , F^(t)  - v . 


Then, 


(1.3.9)  Vgl*)  TM(t) 


' CHiCMJ  t1  (XNi  «»)-»«(«)  Hi  <VjiV)  -F«  (V>  1 

l*j*M 

- y;  Jj.1  CMCHi11  (XH1  * U>  - PNi  (U>  Hi  <*»!  « V,  - PHi  (V)  ) 


-lb-' 


+ SNSM  i5j  CNiCl^  (XNi  * U)  " Fn1 (U) ^ 1 (XMj  SV)  " FMj (V) J ' 

In  the  first  term,  we  have  used  the  fact  that 
and  FNi  = FMi  for  i<H  . We  observe  the  following: 

(i)  when  i ^ j , X^  and  X^  are  independent. 
Hence  EC IHx^iul- FS1  (u) } {I (x^  <v) 

- ECKx^.u)  -fn1(u)]  eCKXjjj  ev)  -F^.(V)]  -0  . 

(ii)  when  i = j , 


(1.3.10)  CKX^eu)  -FNi  (u)][i  (xsl  <«)  -PNi(v)] 

- i<xltl«o)i(xsl*v)  -i(xHleu)Flsl(v) 

- I(xHi  «v)Fsi(u)  +Fsi(u)FN1(v)  . 


In  (3.10),  we  observe  that 


Efl(XNi  *u)I(XNi  * v))  * Fjji  (u  A v)  - FNi(u)  AFNi(v) 


Taking  expectations. 


(1.3.11)  E[(I(XNI«U) -F1I1(a)){I(x1Ii*v)  -FNi(»))] 


FH1(a)  AFsl(v)  -Fsi(u)F81(v) 

PNi<FH1(t))  AFNi(FM1(t)>  -PNl<FN1(t))FHi<FM1(t)) 


19- 


By  (i)  and  (3.11)  , substituting  in  (1.3.9)  after 
taking  expectations,  we  get  (1.3.8)  which  completes  the 
proof  of  Corollary  (1.3.3). 


1.4. 


The  Limiting  Distributions  of  the  Processes  x^t) 
and  YN(t)  s 


In  section  3 , we  have  found  criteria  for  ^-convergence 
of  the  process  YN(t)  • Conditions  for  XN(t)  are  much 
simpler  and  are  well-known. 

We  can  rewrite  X^t)  as  , 


X^t)  = ^ (Gjj(t)  - t)  where 

V«  - ■ 

E(XN(s)XN(t))  = l^(a,t)  = 

’ * A 4 ' N Jj  (,)  ’ PNi  <PN1  (t)  > • 

Then  the  process  X^t)  converges  weakly  to  a Gaussian 

process  X(t)  with  E(X(i)X(t))  * K(s,t)  - lim  K^(s,t) 

N-*+-  N 

if  and  only  if  the  above  limit  exists. 

Further,  under  the  above  condition 


(1.4.1) 

(1.4.2) 


(1.4.2) 


MxlXntt)  -x(t)  | 


0 a.s. 
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Hence  £2-convergence  is  immediate.  Proof  of  these  can 
be  found  in  Shorack  [19], 

Next  we  obtain  conditions  for  convergence  of  the  process 
YN(t)  . The  following  theorem  gives  the  conditions  for 
X2-convergence  of  YN(t)  . 

Theorem  1.4.1  : Let  conditions  of  theorem  1.3.2  (or 

corollary  (1.3.3)  be  satisfied.  In  addition  let 

U.4.3)  (max^  - 0<^>  . 

X, 

Then  YN(t)  — ♦ Y(t)  where  Y(t)  is  Gaussian  with 
kernel 

R(s,t)  » lim  R^(s,t)  . 

N-*+««  “ 

Proof  : £2  convergence  and  convergence  of  the  kernel 

have  been  established,  it  remains  to  show  that  the  finite 
dimensional  distributions  of  Yjj(t)  are  asymptotically 
normal. 

Let  t2# . . •»tjc  € T be  arbitrary. 

We  have  to  show  that  the  random  vector  (^(t^  , . . . /Y^t^  ) 
is  asymptotically  normal. 


We  use  the  Cramer-Wold  criterion.  Let  ai»»««»a]c  be 
arbitrary  constants,  it  suffices  to  show  that 
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(1.4.4) 


^aj  is  asymptotically  normal. 


Again  to  simplify  our  notation,  we  write, 
PN1(tj)  “ Uj  ' ^ * 1,2, ...,k  . 


Then 


(1.4.5)  Z a,Y„(t.) 

j=l  ^ N j 


k N C. 


C 

(1.4.6)  = — g— — ? then  * 0(1)  , and 


W - <WI<XNi*V'FNi(Uj)) 


Then  , 


(1.4.7)  Z a.YM(t.)  -i-  Z a . Z Y„,  (uj 


j N'  j ' J&  ^ j 


Ni  j ‘ 


£ Jr  ‘Ji  "lYNt  (uj  * 1 • 


L‘t  °Hi  - “l.1.  Vni(uj)! 


2 _ N 2 
aN  * aNi  * 
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Observe  that  because  of  (1.4.6),  each  term  of  the  sum  in 

k 

(1.4.7),  viz.,  { £ a.Y  . (u.))  is  bounded  uniformly  in  N . 

j=l  3 N1  3 
2 

Further,  in  (1.4.8),  <jn  is  a monotone  increasing  sequence 

2 

since  its  terms  are  all  nonnegative.  Thus,  if  oN  is 

2 

bounded  above,  it  converges  to  some  an  and  then 
k 0 

£ a.YM(t.)  is  degenerate.  (Because  its  variance  is 
j-1  3 N 3 


1 n2 
N a 


-♦  0 if 


N 


if 


'N 


is  bounded) . 


If  on  the  other  hand 


N 


is  unbounded. 


°N  **  +"  * 


we 


have  asymptotic  normality  of  £ a.YM(t. ) by  the  Bounded 

j=l  3 N 3 

Liapunov  theorem. 

Thus,  in  either  case  we  have  asymptotic  normality 

k 

(possibly  degenerate)  of  £ a.Y  (t.)  . Hence  by  the  Cramer- 

j=l  3 N 3 

Wold  criterion,  the  process  YN(t)  is  asymptotically 
(possibly  degerate)  normal.  Thus  the  proof  of  theorem  4.1 
is  complete. 


1.5.  Asymptotic  Normality  of  Certain  Stochastic  Integrals 
of  the  Processes  ( t)  and  YN(t)  . 

In  this  section,  we  will  obtain  conditions  for  the 
asymptdtic  normality  of  the  stochastic  integrals. 


(1.5.1) 


yh  “ V*>r<t>at 


where 


(1.5.2) 


(1.5.3) 


c(t) 


JlCHlFNi(FS1(t)) 


and 


cp  is  a known  function. 


This  in  turn  will  enable  us  to  obtain  asymptotic 
normality  of  the  simple  linear  rank  statistic  SN  defined 
in  (1.1.1). 

In  the  next  theorem,  we  will  obtain  bounds  for  the 
variances  of  Xjj  and  YN  . 


Variance  Inequalities?  Next  theorem  is  crucial  for  obtaining 
the  limiting  normality  of  Xjj  and  . 

Theorem  1.5.1  : Let  X^ , , X^  be  independent 

random  variables  with  continuous  distribution  functions 
FN1#  * • * * fnn  * Under  the  assumptions. 


(a) 


max|c  | 
l<i*N 


(b)  |qp/(t)l*K|t(l-t)l6“3/2  , for  some  5>0, 


we  have  , 


Var  Yn  * 


2 


5-4* 


(1.5.4) 


0(1) 


25- 


(1.5.5) 


Var  X, 


N 


K2 

* 6* 


,5-46 


0(1) 


where  Xjj  and  YN  are  the  random  variables  defined  in 
(1.5.1)  and  (1.5.2)  respectively,  corresponding  to  the 
sequences  (Xu^...,}^)  and  (P^...^^)  . 

Proof  : First  consider  Y„  . 

N 

YN  * Xj  YN(t)cp'(t)dt. 

Clearly,  EY^  * 0 . Thus 

(1.5.6)  Var  YN  * E YN(s) YN(t) cp'  (s) <p'  (t) dsdt 

■ X^  X*  R«(s,  t)  cp' (s)  cp' (t)  dsdt  , if  it  exists 
0 0 

By  (1.3.5), 

N 

V.,t>  -4-  S CSi(PBi<^1<»>><1-FHl(Pi1<t>>>)  •“  • 

■N  1-X 

By  the  Cauchy-Schwarz  inequality, 

!Rs(*  pt>l  * {RN(s,s)RN(t,t)  J*5  . 

Thus,  substituting  in  (1.5.6)  we  get. 


(1.5.7)  Var  YH  * (jJ{RN(t,t)  iV  (t)dt)2 

- [J^f  ? -jp  (rNl  (f"1  (t) ) (i  - fn.  (f“H)  ) I15*'  (t)  dtj2 
0 1-1 

Consider, 

N C2. 

(1.5.7/  Rjjtt.t)  - Z FNi(FN^t))  (1“FNi(FN1(t),) 

i-i  sN 

* 5 PHl<FN1(t))  °<»  * 

Since,  0 s FNi  (F”1  (t) ) si  and 

0 s 1 - FNi (f”1 (t) ) sl  we  have 
1 N , 

(1.5.8)  S 0(1)  ± Z FNi(FN  (t))  " t 0(1)  and 

1 N , 

(1.5.9)  RjjU.t)  S 0(1)  ± Z (l.-FHi(FHA(t)))  * (1-t).  0(1)  . 
Thus, 

(1.5.10)  J’J{RN(t,t)},s  <p'(t)dt  - ^{^(t.t^cpMtJdt 

+ J1(RH(t,t))V(t)dt. 

% 


Next,  we  have  by  (1.5.8)  and  assumption  (b) 
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|J*5{RN(t,t)},5cp,(t)  dtj  sf’5  t^cp'  (t)|  dt  0(1) 


* K J*  t^ftd-t))6'372  dt  0(1) 


* K J**  t*  t6“3/2  (l-Js) 


6-3/2 


dt  0(1) 


J-372 


f*  t6"1  dt  = | 2 


k ,3/2-26 


0(1) 


Similarly  by  using  (1.5.9)  we  get. 


£ * 23/2_t  0(1). 


Thus,  we  get 


(1.5.11)  |J’1(Rs(t,t))'V  (t)dt|  .0(1)  ^ 23/2-26,|  25/2-26  0(1) 


Substituting  in  (1.5.9),  we  get 


{;1{R^(t,t)),5(p/(t)dt}2  < 0(1)  ^ 2 
0 
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This  proves  (1.5.4) 
Next  consider 


^S*  - ^7S  i"o  V*)«p'(t>ao(t)  • 


Without  loss  of  generality,  assume  CHi  * 0 ; otherwise 
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0 


we  replace  CN-  by  |cHi| 


'Ni1 


Var 


- — T-  J1  J*1  Vs't)cP'(s)cP'(t)<ac(s)dc(t) 
Ns*  0 0 “ 


* “^2“  J1  J,1|Ku(S't)  1 |cp'  (s)  cp'  (t)  |dc(s)dc(t) 


Ns“  0 0 

1 cl 


C^Ns^”  J*q  UKN(t»t))>,5|<p' (t))dc(t) } 

”>aaClCMil 


Observe  that  a 


0 (— ) . Thus 


var  XH*0(l){J‘1(KH(t,t)]'5|tI,'(t)  |dtV 


t#  s Jx  pNi  <fh^)  ) d - FKi (^h1  ( t) ) ) l*5 1 =p'  (t)  Idi] 2 OUI 


This  we  have  already  estimated  and  found  to  be 


* K 25"46  0(1)  . 

b* 

K 5-iA 

Thus  Var  XgfO(l)  — 2 , which  completes  the  proof. 

We  are  now  in  a position  to  prove  the  following  theorems 


on  the  asymptotic  normality  of 


and  Yn  . 


Theorem  1.5.2  t Let  X^t)  and  be  defined  as 

before.  Assume 

(a)  E XjjfsjX^t)  ■ Kjj ( s , t)  -*  K(s,t)  , Vs, t € T 
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<b>  ”UH  |C»i|/S^  " 0<^_> 


|o'(t)|  *K|t(l-t)  |4‘,3/%  or  some  6 > 0 . 


Then  given  any  e > 0 , there  exist  Ng  , such  that 


N 2 NQ  entails,  j]^  - X||  < e , where 


(1.5.12)  X » J*1  X(t)  cp'(t)dc(t)  is  a Gaussian 

random  variable  with  mean  0 and  variance 


xf  = J*1  J1  K(s,t)cp' (s)cp' (t)dc(s)dc(t) 


Ns  J 0 0 


where,  as  before 


C<t>  * ill  CHiPHt(PH  (t,)  • 


Proof  : First  we  observe  that  convergence  of  K^ts.t) 

to  K(s,t)  entails. 


max  |xN(t)-X(t)| 
Ostsl  v 


0 by  condition  (1.4.2) 


Thus  HXjjtt)  — X(t)  U — ¥ 0 and  X(t)  is  Gaussian 

with  mean  0 and  kernel  K(s,t)  - lim  IC-(s.t)  . 

N**+« 

Next,  we  observe  that,  assuming  C„.  *0  , w.l.o.g.. 
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(1.5.13)  1|X||  -J-  (J1  ^ K(s , t)  <p'  <s)  cp'  (t)  dc  (v)  dc  (t)  J*5 
v N 0 0 

* /A—  r1  (Ktt.oj^icp^tjidctt) 

v N 0 

* lim  N sup  jJ  K^(t.t)|<p'(t)ldc(t)  <♦* 

by  theorem  (1.5.1)  . 


Next, 

llx^xll  * 11  ^5Tn  J‘J(xN(t)  -x(t))cp/(t)dc(t)H 
s J*0  ^5^  "XN(t)  -x(t>  lllcp' (t)  |dc(t) 

<♦*  . 


Thus  we  can  use  the  generalized  dominated  convergence 
theorem,  as  Ux^ft)  -X(t)||  -*  0 , we  must  have. 


ll^-xll 


-♦  0 . 


Thus  for  N sufficiently  large. 


-Xl|  < e 


which  completes  the  proof. 
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i 


Theorem  1.5.3  : Let  in  addition  to  the  conditions 

(b)  and  (c)  of  theorem  1.5.2  above  the  conditions  of  either 
theorem  1,3.2  or  of  Corollary  1.3.3  be  satisfied.  Then. 
given  any  e > 0 , there  exists  NQ  such  that  N 2 Nq  entails 

1|YN  - Y|1  < e where 

(1.5.14)  Y - T1  Y(t)*'(t)dt  and 

J0 

Y(t)  is  a Gaussian  process  with  mean  0 and  kernel 

(1.5.15)  R(s, t)  - lim  R-. ( s , t) 

N-M-. 

N 

« lim-lj  I F (F-l(s))(1_F-l(t))) 

N-M-c.  s£  i*l  N1  N1  N N 

with  sit  , 

Proof  t By  theorem  1.4.1,  we  have  £2-conver9ence  of  Y 
YN(t)  to  a Gaussian  process  Y(t)  . 

Again  observe  that 

|JyI|  ■ {J1  J*1  R(s,t)cp/(s)cp/  (t) dsdt}** 

0 0 

* (R(t,t)  (t)  |dt 

s lim  N sup  (t#  t)  J*5 1 cp'  (t)|dt  < ♦ «4 
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by  theorem  1.5.1, 


Thus 


11YN-YH  " Hf^V^  -Y(t))q>/(t)«at|l 
* J^lIVt)  -Y(t)  |||cp'(t)ldt 


0 as  N -*  + • . 


Since  ||YN(t)  -Y(t)|||cp'(t)\  . 0 and  the  integral  Is 
dominated  by  ,1 


n»xu>.*  iY(t)iD  icfUMdt 


Thus  HYu“y  H < c for  N large  enough.  This  proves 
the  theorem. 


1.6. 


Lmitincr  Distribution  of  a Simple  Linear 
Rank  Statistics 


We  are  now  in  a position  to  prove  the  asymptotic 
normality  of  the  statistic  defined  in  (1.1.1) 


Recall  that 


SN  " * CNi  * 4+1  > • 
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We  make  the  following  assumptions: 

(a)  |cp(t)) £ Kft(l-t)  **  , some  6>0 

| cp#  (t)\  * K{t  (1-t) } 6"3//2  k being  a generic  constant. 

(b)  Conditions  of  theorem  1.3.2  (or  Corollary  1.3.3) 
are  satisfied  and  the  kernel  K^s.t)  -»  K(s,t)  . 

<c)  c»i>(v,,r  s«)j!  ■ “'i*1  • 

We  then  have  the  following  theorem: 

Theorem  1.6.1  : Let  the  independent  random  variables 

XNl,***#XNN  continuous  distribution  functions 

FNl'***'FNN  be  such  that  conditions  (a)  , (b)  and  (c)  are 
satisfied. 

Then. 

Var  SN  * 0 

where 

(1.6.2) 


Uw  " J1  <p(t)dc(t) 

" 0 

C<t)  \i  CHtPHi(PNl<t>> 
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* 


and  Var  S„ 

1 N 


(1.6.3)  s* 

(1.6.4)  An. 


can  be  taken  to  be 
N 


mill  Var  ANi(XNi}  WhCre 
1 N 

(x)  = N.z.(CNj  "CNi )j’“  {I(xsy)-FNi(y)}cp/(PN(y))dFN  (y) 

J “1  "•  ^ 


Remark  s The  condition  on  cp  is  the  same  as  that 
imposed  by  Puri  and  Sen  [22]  and  slightly  stronger  than 
tfajek  [12]  . Otherwise  the  theorem  is  not  different  from 
H&jeck's.  The  conclusion  of  the  theorem  is  slightly  stronger 
in  the  sense  we  have  obtained  the  centering  constant  jaN 
not  given  by  Hajek.  This  (ijj  arises  naturally  during  the 
course  of  the  proof  without  a separate  analysis  as  done  by 
Hoeffding  [14]  . Hajek's  principal  tool  is  his  remarkable 
but  difficult  variance  inequality  which  is  replaced  here  by 
the  much  s impler  theorem  1.5.1. 


Proof  of  Theorem  1.6.1  s We  can  write  the  statistic  SN 

as 


(1.6.5)  SN  " ^(t))  dCN(t)  where 

d.6.6)  cN(t)  Sl1^11;1^)) 

1 » .1 

(1.6.7)  Hjjft)  E I(XHiaPNA(t))  . 
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It  is  easy  to  check  that 

(1.6.8)  SN  ■ + bin  + B2n  + °1N  + °2N  + °3N  where 

|jiN  has  been  defined  in  (6.2) 

(1.6.9)  B1n  = J*  cp(t)d(CN(t)  -C(t)) 

(1.6.10)  B2n  = (Hjj(t)  -t)cp'(t)dc(t) 

(1.6.11) _  bZ1  f1  IL_(t)<*>'  (t)  dc(t) 

°1N  " N+l  0 “ 

(1.6.12)  D2n  = /^(^(t)  - t)cp'(t)d(CN(t)-C(t)) 

(1.6.13)  D3n  = J^cp^  t)  - cp(t)  - (^j  H^tJ-t^'ttUdC^t) 

We  will  show  that  (i)  ||iN|  < + • 

(ii)  (Bin  + B2n)  is  asymptotically  normal 

(iii)  DiN  » op(sN)  , i * 1,2,3  . 

The  proof  of  (i)  and  (iii)  are  given  in  the  next 
chapter.  We  prove  (ii)  below. 

Integrating  by  parts,  we  have 

B1N  “ " J*(CN(t)  "C(t,)cp/ (t)dt  + (CN(t)  -C(t))cp(t)  |J  . 

(1.6.14)  Let  ZN(t)  - <p(t)  £CN(t)  -C(t)}  . 
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Claim  : Z..  (t)  = o (s„)  as  t -♦  0 or  1 

- N p N 


Var  ZN(t) 


N 


N 


CNifPNi<rH1<t>><1-WFNl<t)))> 


N 

N 


< 0(1)  cp2(t)  ^ Z FNi(FN1(t))  (1-PNi(FN1(t))  * 


Observe  that  0 £ (f”1  (t) ) si  and 

0<i'PNi(pir1{t))<i  • 


Hence  their  product  is  less  than  the  individual  factors. 
Hence 


Var  ZN(t) 


'N 


Var  ZN(t) 


'N 


* 0(1)  cp  (t)  t and 


S 0(1)  cp  (t)  (1-t)  , Vt 


Consequently, 


Var  ZN(t)  2 2 A— 1 

jS s 0(1)  ir{t(l-t)r°  1 t -♦  0 as  t -»  0 


’N 


and  Var  ZN(t) 


2 6-1, 


<0(1)  k‘(t(l-t)}t0  "(l-tJtO  as  t-»l 


N 


,Z.r(t) 


Thus  Varf-^- — ) -*  0 as  t -♦  0 or  1 
\ sN  / 
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ZN(t)  * o^(sN)  as  t -*  0 or  1 


Next  we  consider 


sN  *B1N  + B2N*  * 


Observe  that 


IN  « -Y. 


B2n 


where  Xjj  and  YN  are  as  defined  in  (1.5.1)  and  (1.5.2). 

By  theorems  1.5.1  and  1.5.2,  there  exist  Gaussian  random 
variables,  X and  Y such  that  for  N sufficiently  large. 


||xH-Xl|<c/2  and  Hyn  - Yjl  < c/2  . 

Thus  H (X^ YN)-(x  - Y)  H<  e . But  X-Y  is  Gaussian. 

This  proves  the  theorem. 


t We  can  now  find  an  expression 


loir  »; . 


Letting  Y ■ F~  (t)  and  observing  that 


c<t)  ‘ ih  cw  pw(V(t>)  c«Vy)  - c<*>  < «*• 


We  can  write. 


1 N 

(1.6.14)  B1n  + B2n  = ^(I(XN.  *y)  -FNi(y)}cp'(FN(y))dc(y) 

• N 

* J_w  .^Ni^^Ni  *y)  -FNi<Y>  }cp'<Vy))dFN(y) 

N 

" if1ANi(XNi)  Where 

ANi  (X)  = N rtltWI*-  pNi  (y)  ) cp'  (Fn  (y)  ) dc  (y) 

" ClIi  0I(X<y)  "FNi(y))I'P/(FN(y))dFN(y) 

1 N 

“ N ^ CNj  ’FNi(y)^/(FN(y))dFNj(y) 

1 N 

“N  ^ cNi{I(x*y)  -FNi(y)}cP/(PN(y))dFNj(y)  . 

Thus  we  have. 


N 


(1.6.15)  ANi(x)  - N j^1(CHj  "qNi,r-fI(xSy)-FNi(y>J'P#(FN(y))dFNj(y) 
2 

**  *Ni  " Var  * »ince  are  all  independent. 


we  have 


2 M 2 

N ii1  Ni 


The  remainder  terms  are  all  o (sM)  . Hence  Var  s„ 

p N N 
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2 

can  be  replaced  by  . 

1.7.  APPENDIX  TO  CHAPTER  I : 

On  the  Identification  of  the  Hilbert  Space  spanned 
bv  the  process  YN(t)  : 

Although  the  material  covered  in  this  section  is  not 
essential  to  the  material  covered  in  any  of  the  chapters,  it 
provides  some  insight  into  the  second  order  behaviour  of 
the  weighted  empirical  process  Y^ft)  • We  explicitly 

identify  the  functions  belonging  to  the  Reproducing  Kernel 
Hilbert  Space  WN  spanned  by  the  process  YN(t)  • 

In  order  to  simplify  the  notation,  we  will  drop  the 
normalizing  constant  s^  and  write 

(1.7.1)  YN(t)  » IiCNifI(XNi  sFNA(t))  -FNi(FNA(t)))  and 

V' "j1CHtfF«i  <PHl(*)  > AFNi  (FN^> ' -FNi  <F^S)  1 FSi  <FN^>  > ^ 

We  identify  the  space  £2^^  spanned  by  YN(t)  with 
a Hilbert  space  ^ of  functions  on  T 

a‘Z2  (YN* 

as  follows  : 


For  the  stochastic  integral 
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Yg  " J'TY»,t)d9(t) 

a . x2(yN) »*„ 

y > f 

9 g 

Vs>  ’ <V  V.>  * <«g  ' AVS)> 

" <Vyn<,)>  " e<Vh(*,) 

- E(Y1I(s)J^Ys(t)dg(t)J  - J RN(s,t)dg(t)  . 

Thus 

(1.7.2)  f (s)  - (AY  ) (s)  - J*  R (s,t)dg(t) 

+ *p  w 

-JlCSi  <F^S>  > *FNi  (FN1(t|  ) -F„i  <F^S» » FHi  <FN^>  > 1 

dg(t)  . 

(1.7.3)  ||fg||2  - (lAYgll2  - ||Ygl|2  - J‘TJ‘TRN(s,t)dg(s)dg(t) 
if  it  exists. 

Thus  consists  of  all  the  functions  fg(s)  * 

J*  Rjj(»#t)dg(t)  such  that  (7.3)  is  finite,  (perhaps  improper). 

I£  Yg  “ J*TYN(t,dg(t)  * Yh  - J*TYN(t)dh(t) 
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A Y, 


A Y, 


(1.7.4)  (fg.fh)  = (A  Yg,  A Yh)  - (Yg  , Yh) 

” EfJ  YN(t)  / Y (s)dh(s)}  - J*  J R^(s,t)dg(s)dh(t) 

T T T T " 

* IT  JT  (FMi  <PH^'  > AFNi  <F^‘>  > * F„i  <F^“>  > FNi  (FH^»  > ) 

dg(s)dg(t)  . 

Example  s Let  = ...  = = F rectangular  (0,1)  . 

Then  R^s, t)  =(s  At-st)  r cj.  . Let  g(t)  = log(t)  . 

Then 


fa(s)  * Z CNi  J1(sAt-  st)dg(t)  . 
* i*l  0 


It  is  clearly  an  improper  integral.  We  will  find  the 

Ilf0H2  " J*1  J*1  RjjU, t)dg(t)dg(s)  . 
y oo  w 

r1(s  At-St)d  log  t - J*  s(l-t)£  dt  + r t(l-$)i  dt 
0 [s<t]  fc  [sat]  * 


-s  log  (s)  . Thus 


v>  ■ :!xchi  ■ io®  • • 

"V  * f-JxCK i /J  • lo*  * a l°9  •}'S  - i'IS  • 
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Thus,  although  g is  not  of  bounded  variation  on  T , 


Yo  “ j\(t)dg(t)  exists. 
“ 0 " 


(A  Y ) (s)  « f (s)  « - E C„.s  log  s . . 
y y j wi- 


lt is  clear  that  a knowledge  of  f gives  us  no  in 

information  about  the  distribution  of  Y . 

9 

On  the  other  hand  if  it  were  known  that  YN(t)  is 

Gaussian  with  mean  0 and  kernel  R^s, t)  above,  f^ 

would  conpletely  determine  the  random  variable  Y , which 

9N  , 

wau  Id  now  be  Gaussian  with  mean  0 and  variance  E C„.  . 

i-1  Nl 
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I 


CHAPTER  II 

A Stability  Approach  to  the  Limiting 
Distribution  of  a Simple  Linear  Rank  Statistic  : 

Preliminaries  : In  this  chapter,  a different  proof  of 

theorem  1.6.1  of  Chapter  I will  be  given  using  stability 
theorems  from  classical  Probability  Theory.  The  proof  will 
be  along  the  lines  of  the  classical  proof  of  the  Chernoff- 
Savage  theorem.  Also  the  negligibility  of  the  terms  D^N 

will  be  shown. 

In  order  to  conform  to  the  standard  terminology, 
we  will  use  H(x)  in  place  of  FN(x)  use<*  in  the  preceding 
chapter.  That  is  to  say, 

BW  ■«  j1,mw  • 

We  follow  the  proof  given  in  Puri  and  Sen  [22]  for  the 
Chernoff-Savage  theorem,  with  some  modifications  necessiated 
by  the  greater  generality  of  the  problem. 

The  Limiting  Distribution  of  a Simple  Linear 
Linear  Rank  Statistic  Under  Alternatives  : 

2.1.  Notation  and  Terminology  t Let  {X^  * IsisN  , Nil} 
be  a sequence  of  independent  random  variables  with  continuous 
distribution  functions. 
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PNi(x)  " P^i  *x)  . 


Let  Rjji • Rjj2 • • • • • Rjjn  be  corresponding  ranks. 
We  define  a simple  linear  rank  statistic 


(2.1.1) 


where 


tp  i (0,1)  -*  R is  a known  function  and  ^i*****0^  are 
known  regression  constants. 

We  are  interested  in  the  limiting  distribution  of  SN 


Assumptions  : 

(a)  | cp(u)  | sK|u(l  -u)!3”15  , 

|cp' (u)  | s K|u(l-u)ls“3/2  * for  some  5>0 

(b)  If  s2  » Var  SN  . then 


JCNil 


lsisN 


N 


Note  t Throughout,  K will  indicate  a generic 
constant. 

We  define 


cN(x)  *i^icNiI  (^  s x) 


(2.1.2) 
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(2.1.3)  C(x)  - E CH1FHi(x) 


(2.1.4) 


Vx>  -i  Z I(xHi.x) 

1*1 


(2.1.5) 


H(x)  = ± ZF„. (x)  . 

N i-1  Nl 


Then  the  following  inequalities  are  obvious: 


(2.1.6)  |C „(x)|iN  max  IcnJHn(x) 

" lsi<N  N1  N 


(2.1.7)  |c (x) | £ N max  |c„. |H(x) 


liisN 


2.2.  Main  Results : 


Theorem  2.2.1  : Let  SN  be  as  defined  inti.  1.1) 

Then  ^ ) »h(0,l) 


a2  i*  0 
N r 


(2.2.1)  uN  ■ J*  cp(H(x) ) dc (x) 


Also  sN  can  be  taken  to  be 


(2.2.2) 


& Var  ANi«XNi) 


where 
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(2.2.3)  ANi(x)  - A I (CH1-Sj)  XV(H<y)>dF  (y)  , 

Xq 

x0  arbitrary  . 

Proof  s Proof  will  be  along  the  lines  of  Puri  and 
Sen  [22]  . 

We  can  write 

(2.2.4)  SN  = <p(^  Hjj(x)  ) dCj-(X) 

* % + ®1N  + ®2N  + °1N  + °2N  + °3N  Where 

lij,  as  in  (2.2.2) 

(2.2.5)  B1n  « J*  cp(H(x))d(C  (x)  - C (x) ) 

(2.2.6)  B2n  * J‘+*(Hn(x)  -H(x))Cp/(H(x))dc(x) 

(2*2#7)  °1N  “ “ N+I  J"-HN(x)<P/(H(x))dCN(x) 

(2.2.8)  D2n  - I*  0^(x)  -H(x))«„#(H(x))d(CN(x)  - C (x) ) 

(2.2.9)  D3n  - J"  (^HN(x)-H(x))cp/(H(x))}dC  (x)  . 

The  proof  will  be  accomplished  if  we  show  the  following: 

(i)  |uN|  < +• 
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(ii)  (B1n  + B2n)  is  a symptotically  normal 

N 

(Ui)  °iN  * °p<sN)  ' 1 = X'2'3  * 

Proof  of  (i)  s |uN|  = |J*"  cp(H(x))dC(x)  | 

— 0» 

< N max  |C  |f  | cp(H(x) ) |dH(x)  by  (1.7)  . 
IsiSN  “ -• 

Hence  by  assumption  (a) 


(2.2.10)  ||j  | <N  max  |c  . |k  ^ruU-u)  } 6-35du  < +•  . 

IsiSN  NL  0 

Proof  of  (jj)  j To  show  that  — (B.„  + B^„)  is 

sjj  J-N  2N 

asymptotically  normal. 

We  will  verify  that  BlN  and  b2n  satisfy  the 
Liapunov  condition  and  then  apply  the  (^-inequality 

(2.2.10)  B^  - J*"  cp(H(x))d(CN(x)-C(x)) 

*JiCB(XNi)  "EB(XNi)}CNi  Where 

8(3^)  - (pWX^))  . 

Consider  next. 
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(2.2.12) 


N 

Z 

i*l 


E | C 


HiB(X„i,|2«'. 


max 

IsisN 


lCNi^ 


2+6 ' 


i|iE|B<XNi)  | 


2+6' 


- »■*  icNii2+6/  ? r icp(H(x))i2+6/dp  (x) . 

IsisN  i=l  -®  N1 

Choose  6 ' s.t.  (2+6')(6-%)  > -1  . Then  in  (2.2.12) 
we  have. 


N 

(2.2.13)  I E jc 
i=l 


Ni 


B 


(XNi>l 


2+6 ' 


max  | C 
IsiSN 


i 2+6  * 


Ni1 


• » * J^JIcplHtx))  |2+6'dFN.(x) 

s max  |CNi12+6/.N  K J*  (H(x)  (l-H(x) ) } (2+6')  (,5“6)dH(x) 
IsisN  -• 

* K'  N max|CNi|2+5/  ; where 


K1  * K J"  {H(x)(l-H(x))}(2+6,)ft-4)dH(x)<+.  . 


Also  by  Jensen's  inequality. 


I EB<JtHi> CHi  1 2+‘  ' ‘ I CHi  I i+S  'E I B I 


2+6 


1 2+6 1 


(2.2.14) 


Hence  E|  (Btx^)  - EBtX^)  )CNi]2+6  ' 
‘ 22+6'  E|B(XNi)|2+fi/|cNi|2+5#  . 


By  (2.2.13)  and  (2.2.14)  in  (2.2.11),  we  have 
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N 


U.IZ.iS)  E|<WB(XNi.>  -EB(Xn.)] 

* 22+6  bi  • max  | C„-  | 2+s  K'  . 
l*isN 


1 2+6 ' 


Hence, 


N 


(2.2.16)  -J-t  .rE|CNi{B(XNi)-EB(XNi)1| 


2+6 


'N 


< K N • max 


i=l 


IsisN  s 


1C  |2+6' 

1 Ni’  r 1 'i 


2+6 
N 


0(  —xr—)  -»  0 as  N •»  + «•  • 
N6/x 


Hence  the  Liapunov  condition  is  satisfied. 
Now  consider, 

B2n  " 1^(1^  (x)  - H (x) ) cp ' (H  (x) ) dc  (x) 
Integrating  by  parts. 


(2.2.17)  B2n  - B*(x)fHN(x)  -H(X)}  |+"-J+*B*(x)d(HN(x)-H(x)  ) 


where. 


(2.2.18)  B (x)  ■ J*x  qp'  (H(x)  )dc(x)  , x_  arbitrary  s.t.  H(xq)>0 


We  will  later  show  that  the  first  term  in  (2.2.17)  is 
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Op  (sN)  . Consider, 


(2.2.19) 


J B (x)d(HN(x)-H(x)))  - E g -J*4- 


We  will  again  verify  the  Liapunov  condition. 


1 ? B (XHi)-E  Bt^) 

4^  i-1  ' 5 ' “ 


0 , as  N -*  + 


Clearly,  as  before  it  suffices  to  consider 

N b*  (v  ) 2+6  „ 

(2.2.20)  1 y r |_____Ni_,  1 r p|R*fv  \ | 

2+6' A E ' N 1 " 2+6  ,Kr2+6 ' ,LEIB  (XNi)  ' 

s„  l-l  s„  N l-l 


2+6' 


•>6\  \i*t>  If  <p'(H(y))<«Hty) 

N (s„)  9 1=1  -« 


2+5' 


dFSi  <x> 


&T  tp'(H(y))dH(y)|23^  (x) 

. N 1=1  -•  lsisN  x„ 


2+6' 


* p+p J*“  | cp(H(x) ) +cp(H(x0))  |2+5/dFNi(x) 


<nV”)  “ iEl  **"  *Cp(H(X))  +^H(xo))l""°'df’Ni(x) 


0(-^r)  Sm  |cp(H(x) ) +cp(H(x0))|2+6/d  H(x) 


0 as  N -»  +•  . 


Since  (2  + 6')(6-3s)  > -1  and  cp(H(xn))  is  a constant. 


Again, 
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k 


(2.2.21)  -3^r-  |B*(XNj>^E  B*(XHi)|2HV . 

By  (2.2.16)  and  (2.2.21),  the  (^-inequality, 

+ Bjjj  satisfies  the  Liapunov  condition. 

In  (2.2.17),  consider  B*(x)  (H^x)  - h(x)  ) | * «g(x)|* 

1^1  “ ItHjjtx)  -H(x)  ]|VS  — |J*X  cp7  (H(y)  )dc(y)  | 

N & xQ 

* JS  \B^(x)  -H(x)||Jx  cp7(H(y))dH(y)  | . 

X0 

Assume  w.l.o.g.  cp7  2 0 . Otherwise  we  can  treat 

q>7  and  cp7  separately. 

+ 

JX  «p7(H(y))d  H(y)  * |[ap(H(x))  - cp(H(xQ) ) 3 | 

X0 

s K(H(x)  ( J- H(x) ) ) ® ^ since  cp(H(x^))  is  constant. 
Var|l^I|  s K2[H(x)  (1  - H(x) ) 326"1  var  ^(^(x)  -H(x)) 

- K2(H(x) (l-H(x)))26-1  H(x) (l-H(x) ) 

■— * 0 as  x *4  ±o»  . 

Hence  ^ 1XJ  .-f,  ; 0 , eft  X — * *.  — 
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Proof  of  (ill)  : DiN  - op(sN)  ; i - 1,2,3  . 

Consider  .pH^x) ,/ <H(x) ) dC(((x) 


(2.2.22)  1^1  s-5^-  ij^  .p'fHt^MC^I 


* 5 JjV1  ,Aer* 


(2.2.23)  V, 


Hi  ’ if  *'<H<XNi>> 


Set  - N , i < N 

- i , i > N 

VL  - 0 , i > N , V.  « VN.  , i<N  . 


Then  (2.2.22)  can  be  written 


• V, 


pS|  . i ili 

1 *H  1 irt  lbi 


We  wish  to  show 


0 . 


This  follows  from  the  "particular  case  1°," 
of  Lofcve  ill}  if  we  show 


page  241 
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- E|V  |° 

I — ^ < - 

i«l  iSV 


for  some  0 < a < 1 


Take  a * 2/3  . Then 


• El V.  I . N Ic  . I J 

& “273  -s273  £ ^571— ElH(xHi)  (l-H(xHl))|2/3<6-3/2) 

1 -?TS  “*  l%2/3  X S’  (H<x>  (l-H(x)  ) ) ,2/36"1)dF„i  <x> 


N l£i*N  N i=l  -• 


O(^)  ? /•  fH(x)  (1  -H(x))}(2/36'1)d  p 

i»l  -• 


Ni 


(x) 


N 


0(1)  | z r (H(x)  (l-H(x)))(2/3fi-1)d  Fn.  (x) 
i**l  — • 

~ -1 

0(1)  J*"  (H(x)  (l-H(x)  ) ) 3 d H(x)  < + • 


uniformly  in  N . 

Where  we  have  used  the  fact 


-J  |-J*| 

IsiSN  N 


Ni i 2/3 


0(T375) 


Bence  ± Li 


(2.2.24) 


°1N  " °p(sN)  * 


I 
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Consider  D2n  - J*  (^(x) -H(x) ) cp;  (H(x)  )d(CN(x) -c(x) ) . 

We  note  that  given  any  e>0  , 0<6'<Jj  , gc(e6')  s.t. 

(2.2.25)  ('^xWI-hu'))6—  *>  < ‘ ■ 


Hence  on  a set  of  probability  > 1 - e , 


^(x)  - H(x)  ||q)^H(x))|<15Cl^Ali.|H(x)  (i  -H(x))  | 


6-6 '-1 


Let  6*  * 6-6'  , choosing  6'  <6  . Hence,  it  suffices 


to  show  that 


(2.2.26) 


K C(e,6' 


a„!/S  r |H(x)  (l-H(x))  (x)-C(x))  §0  . 

N — • " 


We  will  use  the  Liapunov  criterion  for  degenerate 
convergence,  (p.  275,  B(i)  , Loeve  [17])  . 

r.fH(x)  U-H(x)n5*-1dc[|(x).  i|iCNifH(Xcli)  (l-HO^))) 


JH  c. 


(2.2.27)  S.t  vsi  (H(XN.)(l-H(XHi))) 


6*-l 


(2.2.28) 


7>f^  Jj.  <WH«Ni>  (MOW)  I**"1  - VNi 
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1 " P 

(2.2.29)  It  remains  to  show  ± E (V„.-EV„. ) 5 0 

M MX  MX 

will  be  done  if  we  show  that  for  some  a > 0 , 


This 


(2.2.30) 


1_ 

Hl+a 


N 

Z 

i»l 


0 


Next,  choose  an  a>0  s.t.  (l  + a)(5*-l)  >-l 
(i.e.,  0<a<  J • Then, 


& A E|v-|1+a 

& “ax  (CNi)  N 

1 , lsi^N  N1  ,1+g  N 

_ » I a ' 


N N 


N 


iEiE{H(XNi)(1-H(XNi)) 


(1+a) ( 5*-l) 


N 


-X-  0(1)  ^ E J"  (H(x)  (l-H(x)  )}  (1+a)  (6*-1>d  F„.  (x) 
Na  N i=l  — Nl 


-X-  0(1)  J*  (H(X)  (l-H(x)))(1+a)  (6*“1)d  H(x) 
IT1  -• 


->  0 as  !!-*+•  as  the  integral  is  finite. 


Thus  by  Cr-inequality  and  the  Liapunov  criterion 
(2.2.29)  follows  from  (2.2.30). 

Again  we  have  used  the  fact 


J*  “X  lcMil 

liliN 

*N 


0(1) 
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Next  consider. 


D3N  “ r t=P<N?I  Vx))  -^(Htx))  - (~y  ^(x)  - H (x) ) 


X <p'(H(x))}  d CN(x)  . 


We  have  to  show  that 


3N  P 


The  following  substitution  will  simplify  the  proof. 


(2.2.31)  Let  C,„  = 


3N  JS  SN 


It  suffices  to  prove  C3N  * * 

Let  ZN1  < Zn2  < • • . < be  the  ordered  observations 

corresponding  to  X^, . . . ,3^  . 


(2.2.32)  Let  XiN  - |9(jj|j)  -qf»(H(ZNi) ) 

- <T^T  - H(2M. ))<(>' (H(ZK.))  I . 


N . N 

(2.2.33)  Then  |c,„|  < max  r \ita  » 0(~)  E \ 

3N  MtM.  i-1  lN  N 1-1 


where  we  have  used  the  fact  max  |cM. | 

****.  - «(3> 
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and  the  fact  that  H^Z^)  * ^ * 
Next  consider  the  function. 


f (x)  * H(x) (1  - H(x) ) . 


Clearly,  f(x)**0«*x-»±«. 

Since  FNi  are  all  continuous,  given  e > 0,3  0 s.t. 


P(f  (X^)  > — ) > 1 - c , i = 1, 


2a • • • jN  • 


Let  { * min  ' . Then,  v . = 1,2, ...,N  • 

e l<i<N  6 1 


(2.2.34) 


P(f(XNi)  > ^ ) > 1 - e . 


Let  Kjj  » [N6  3 where  0 < 6 ' < 6"/2  < 6/4  . Then 
(2.2.33)  can  be  written. 


(2.2.35)  lC3ljl  *C3N^  + C3N^  + C3N^  where 


Kjj  Kjj 

(2.2.3«)C<J>.  0(i)  X1H  . C<*>-  °<5>,|  *iN  • 


N-IC. 

C(3).  Q /A\  £ » 

C3N  0(N)  t.^+1  XiH  ‘ 


Kj,  Kjj 

(2.2.37)  Consider  C*X)s  0 (-g) cp(^jj)  |+0(^)  I |?(H(ZBi) ) | 

*N 

+ 0(N)  JJn+T  - H(ZNi)  I l»#  <■<■»»  I • 
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In  (2.2.37),  consider  the  £irst  term; 

Kjj  Kjj 

(2.2.38)  0(£)  jMq P^T)|  -0(i,  ^(1-^,1^ 

^ K °(jj)  KjiC  (N+lf  ^ **  * 0(h)  * °(  „6-%  * 


0(  «)  * o(N~^)  since  6 > 5"  . 


-JFZT' 


.(i) 


fi)  ’’L 

Let  > 0 be  s.t.  P(H(ZN-)  >-jJ—  ) > 1 - e 

Let  Tt  * min  . Then  V.  = 1,  ...,N  . 

c lsisN  c 1 


(2.2.38  )' 


P(H(ZNi)  > -j£)  > 1 - e . 


Hence  with  probability  greater  than  1 - e , 


°<S>  j%<H(Zsi>)  < Kjj  0(i)  K|^  (^)|8J5 


* 0(£)  N^OtN"*5”6) 


(2.2.39)  - 0(N“  since  6 >6' 


Next  note  that  |-i-  - H(ZNi)  | - ^(Z^)  -H(ZNi)  | . 

Next  let  XN  be  the  interval  in  which  H(x)(l-H(x)) 


> -£•  where  ( ^ is  given  by  (2.2.34).  Then  with  prob  > 1-e 


ZNi€IN#  1 " 1,a,,'N  7 by  (2.2.34)  . 
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Hence  with  probability  > 1 - e , 


Ih+I  - H(ZHi)||»'(H(ZNl))| 

C K ^ t S i 6 ) 

* N ' 

Hence , with  prob  > 1 - c 

Kj, 

°<S>  ' H(ZNi>ll<P'(H(ZH1))  | 

£ » C(gi  6)  v A,  6~*1  v #— x 

K JN  Vn'  ) (N} 


““3 


CUfcil  h6”  0,i) 


(2.2.40)  » 0(N  **  ) * OfN-*5)  since  6"  < ft 


Hence  by  (2.2.38),  (2.2.39)  and  (2.2.40)  we  get 


C3»)“  Opf**”*5)  # To  show  C3N^*  • Observe  that 

ci2> ■ o(— ) S X 

V „ *iN 


'3N 


'3N  p 

, „ and  hence  has  exaxtly  the  same 

i-N-Kjj+1  1W 

number  of  terms  (viz  Kjj)  as  . Hence  by  symmetry 


(2.2.41) 


,(2), 

'3N 


°p<N  } 


It  remains  to  prove  o_(H“^)  , Proof  of  this 

i*  exactly  as  in  the  Chernoff-Savage  theorem,  (Puri  and  Sen 
[22],  pages  402-405). 
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Set, 

(2.2.42) 

S^Mt)  = {x  s 

T * H(X)  * 1-t} 

(2.2.43) 

42)  <T>  " (x  s 

zn.kb<x<h'1< 

(2.2.44) 

S^3\t)  = {X  ; 

h“1(1-t)<x<Znn, 

Then, 


2 

(2.2.45)  Tkl  C<3)  *0(1)  Z J*  -<P(«(x)) 

jai1  SN^t) 

- (N+I  ^(X)  -H(x))q>,(H(x))|dHN(x)  . 


Let  v > 0 be  arbitrary  but  fixed.  Then 

Jj 

(2.2.46)  sup  sup  ^ |cp(u  +-Tjj)  - <p(u)  -/— • <p'  (u) \+  0 
|u|*c  tsujcI-c  v 

as  »■♦+•  (definition  of  the  derivative  and  | cp'  (u)(*K|u(l-u)  | s“3//2) 

By  (2.25) , with  probability  > 1-e  , for  any 
«1  > 0 , we  have, 

(2.2.47)  J */N|9(n?T  HjjCx))  -<p(H(x)) 
s'^t) 

- (^  Hjjtx)  -H(x))«p'(H(x))  |d  H^x)  < €i  . 


Using  a linear  approximation  we  can  write. 
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(2.2.48)  J*  Hjjtx))  - v(H(x)) 

s<n-o 

- (^+1  Hjj(x)  - H(x) ) cp'  (H(x) ) IdH^x) 

* J',.1^>5?r V=° -H(x)i 

S^T) 

x |q>'[gH(x)  + - cp#  (H(x) ) | d H^x) 

j — 2,3#  0 < a < 1 • 


Because  of 


IL.(x) 

(2.2.49)  (a  H(x)  + d-eOgJlV*) ) /H(x)  = a+(l-a)^i 
and 


(2.2.50)  1 ~ [a  H(x)  + d-g)N+1  ^(x)] 

(l-H(x)) 

■ g + (1-g)  (1  ~ N+I  hn(x) ) 

(l-H(x)) 

and  by  (2.2.34)  and  (2.2.38  )*  , with  probability  greater 

{^(xj  + d-a)—!^^) } fl-CgHtxJ  + d-a^Hjjtx)  ]} 

(H(x) ( 1-H (x) ) 

> P1  <N+1>2  T j - 2,3  . 


than  1 - 2c  • 

(2.2.51)  inf 

x€Sj^\t) 


— b J — 


J 

I 


* 

]\ 

*1 


(2.2.52)  [ *\J£-  H^xJ-Hfx)  | |cp/CaH(x)  + (l-a)'j~-H  (x)  ] 

SN  <T> 

- cp#  (H(X))  jdHjjtx)  <c(£,6')K(1+0^+26)J  lH(x)  (l-H(x))}5*"1 


d ^(x)  * j —2,3 


N01  ft* 

P1N  ■ N+r  * 6*  » 6-6"  , 0<  6’  <-y  . 

3 

(2.2.53)  I J |H(x)  (1  - H(x) ) | 6*“1  ^^(x) 

3=2 

* JqIhW  (l-H(x)  ) | 6*"1dHH(x)  + J1  (H(x)  (l-H(x)  ) | ^*”1dH-J (x) 

1 “T  N 


Yt  $ 0<t<%,  we  can  take  expectations  of  the  right  hand 
side. 


(2.2.54) 


J*  H(x) (l-H(x))}6*-1d  H(x)  s T6* 

(0<X<t) U(1“T<X<1)  6* 


Given  € > 0 , 6'  , choose  t s.t. 


^ c(®»  6')  .K(l+ej6“3)T6*<^e  # 


Hence  in  (2.2.48),  the  sum  for  j » 2,3  is  bounded 
above  in  probability  by  a quantity  which  can  be  made 
arbitrarily  small. 

By  (2.2.47),  the  same  is  true  for  j • 1 . 

Thus  we  have  the  result. 
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Variance  Computation; 

Clearly,  the  variance  contribution  is  by  B +B 

2 IN  2N 

B1N  “ I"  cp(H(x))d(C  (x)  - C (x)  ) 

— o»  a 

B2n  “ " I"  B*(x)d(HN(x)  - H(x) ) where 

B*(x)  = Jx  cp'(H(y))dc(y)  . 

X0 

We  can  drop  c(x)  and  H(x)  since  centering  does 
not  affect  the  variance. 

(2.2.55)  cp(H(x) ) = J*X  cp' (H(y)  )dH(y)  + cp(H(xn) ) . 

X0  ° 

(2.2.56)  VarfB^  + B2n)  = Var{J*  Jx  <p' (H(y) ) d(H(y) ) dCM(x) 

— x0 

- J*  JX  «p,(H(y))dc(y)dH1I(x))  . 

"*  X0 

bin  -j,  'P(HCxNi))cNi 

B2M  - - i B*<V> 

(2.2.57)  where  B*(x)  « Jx  cp' (H(y)  )dc(y) 
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Ckm  N v 

(2.2.58)  Put  AN.(x)=-gi-  I JX  cp'(H(y))dFNj(y) 

' N J.°H1  r^-'IHfyndF^ty)  . 
j A xo 

1 N * 

(2.2.59)  i.e.  ANi(x)  Z <=Bi*CHj,r  =p'  (H(y)  )dFHj  <y)  . 

J“1  x0 

By  (2.2.55)  , (2.2.56)  , (2.2.57)  and  (2.2.58) 

Bm  + b2«  -Jl  'WV  • 

Hence  Var(B1(J  + B2[))  Var  A^IX^)  . The 

expression  (2.2.59)  is  the  same  as  that  given  by  H&jek 
except  for  the  centering. 
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2.3  Extension  of  the  Main  Results: 

We  have  assumed  thus  far,  in  both  the  chapters  that 
the  scores  a are  generated  by  cp  as  follows: 


(2.3.1)  - <p(— ) 

However,  we  are  often  interested  in  the  limiting  behaviour 
of  the  simple  linear  rank  statistic  S when  the  scores 

M 

are  given  by 


(2.3.2) 


Ni 


- EcptU^) 


where  is  the  ith  order  statistic  in  a sample  of 

N independent  random  variables  distributed  uniformly  over 
(0,1)  . Hajek  [12]  has  shown  that  the  limiting  distribution 
of  is  the  same  whether  the  scores  are  given  by  (2.3.1) 

or  (2.3.2).  But  as  mentioned  earlier,  Hajek  does  not  give 
an  expression  for  the  centering  constant.  Hoeffding  [14] 
does  find  the  centering  constants.  Unfortunately,  there 
is  a lack  of  symmetry  in  Hoeffding 's  results  in  the  sense 
the  centering  constants  are  different  depending  upon  whether 
one  uses  the  scores  given  by  (2.3.1)  or  (2.3.2),  unless  one 
makes  the  additional  assumption. 


ISM 

(CN  “ N 


max  | C 
l<i<N 
N 


Ni 


1-1  W1 


(2.3.3) 
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ia  bounded.  This  is  rather  an  unnatural  state  of  affairs 
because  our  experience  with  all  the  special  cases  suggests 
that  asymptotically  the  two  statistics  should  be  equivalent 
in  the  sense  ( ^ - ^*)/sN  •*  0 in  probability.  We  will 
establish  this  fact  using  an  approach  originally  due  to 
Chernoff  and  Savage.  We  assume  that  «p  is  the  inverse  of 
a distribution  function.  This  covers  most  cases  of  practical 
interest  and  also  makes  the  results  much  more  elegant. 

The  following  construction  will  simplify  our  task. 

Let  the  scores  be  given  by. 


(2.3.4) 


Ni 


VU  = BP('J  HU) 


On  0<  t<  1 , we  define, 

{2.3.5)  cp„(t)  »>  a 

N i*l  Ni 

where  [a}  » largest  integer  < a • 

For  the  rest,  the  notation  and  terminology  are  exactly 
as  in  the  earlier  sections  of  this  chapter.  The  following 
lemma  is  helpful. 


Lenina  2.3.1:  Let  cp  be  the  inverse  of  a distribution 


function  and  also  satisfy  the  conditions  of  theorem  2.2.1. 
1&  addition,  let 
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(2.3.5) 


Then 


icNii 


max 
l*i<N  SN 


0(^>  • 


(i)  lim  ep  ( t)  - cp(t) 

H.+.  N 

(in  i j*tvs5rVxn  •tp(5?iVx,>>,JVx) 


°p(V 


Proof?  We  will  prove  (ii)  as  the  proof  of  (i)  can  be  found 
in  Puri  and  Sen  [ 22} , pages  408-409. 

Proof  of  (ii) ? Recall  that 

>CB(x)>  * >1.  °Ni  tI(xNi**)|  < r 

i»l  1<i<n  i-l 

Hence , 

NH  (x)  NH  (x) 

(2.3.7)  if  cviSr > ~ 9 (“^T  ndCN(x)| 


* 1“^NlGNili4i'CpN(N+1  W*  ” ^N+l  HN(XMi})l 
flCNil  ^I^N^N+l^  ~ 9 (N+1*  I * 


max 

l<i<N 


Now, 

(2.3.8) 


max 

l*i«N 


lCNi'  M 


®N  “tp(N+l)l 


o(yi^i'cpNW  “^^n+i5! 


H 
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Set 


(2.3.9) 


\-N 


In  view  of  (2.3.7)  and  (2.3.8)  (ii)  will  be  established 
if  we  can  show  that 

lim  A • 0 . 

*♦+•  N 

This  is  done  in  Puri  and  Sen  [16],  pages  409-411,  and  the 
lemma  is  proved. 

Consider,  with  the  scores  given  by  (2.3.2) 


(2.3.10) 


SN  CNi*N(RNi)  * 


Let  S be  defined  as  before.  Clearly, 
N 


(2.3.11) 


S* 


t SiVsSl’ 

- f V**  VX,)dVX’ 


Theorem  2.3.2:  Witt*  £hfe  def  jniUgng  glyefl,  JL £&  <P  g*Ugfr 

conditions  of  lemma  2.3.1.  Also  let  max  | C . 1 s"1-  0 (-^)  . 

lsi<N 

“ Ujj 

Then,  X( ) -*  h(0,l)  , where  u„  is  the  same  as  that 

N 

tSJL  SN  . 

Proof:  We  can  write. 
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SN  “ SN  + (SN  “ SN) 


Since  we  have  already  established  in  theorem  2.2.1 
the  fact  that 


®1J  " Umj 

£ . ) - h(0,l)  • 


it  suffices  to  prove  that 


(2.3.12) 


S - S* 
_N _N 

SN 


0 in  probability. 


Then,  Polyaks  theorem  gives 


£(fN^N)  ^ n(Q#1) 


N 


But  by  ( 2 . 3 . 11) , we  have 
S„  - S* 


' ®N  ' * SN  VX))  “ N+l 

- 0p(l)  by  Lemma  2.3.1.  This  proves  (2.3.12)  and  hence 
the  theorem  is  proved. 
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CHAPTER  III 

Multivariate  Extension? 

3.1  Pre liminar ies : In  this  chapter  we  extend  the 

results  of  chapter  I for  the  case  when  the  observations 
XNl«  ...»  are  p-variate  random  vectors.  We  use  the 
Cranfer  - Wold  technique  for  this  purpose . A multivariate 
extension  along  the  lines  of  Hajek's  original  proof  as  well 
as  some  testing  procedures  based  on  it  can  be  found  in  Puri 
and  Sen  [21]. 


3.2  Notation  and  Terminology : Let  X^,  ...»  3^ 

be  a sequence  independent  p-variate  random  vectors  with 

continuous  distribution  functions  F„. , . . . » P.„  . To 

NJ.  NN 

be  more  explicit. 
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sample  of  random  vectors  X^, 
0.2.3)  3^  = 


v(l) 

*N1 


v(2) 
** a 

V(v) 

Nl 

X(P) 

*Nl 


Y(l) 

Ni 

y(2) 

Ni 

V(v) 
*N i 

x(p) 

ni 


defined  by 

.(1) 


. X 


. X 


(2) 

HN 

(V) 

NN 

(P) 

NN 


In  the  matrix  XN  observe  that  each  row  (X^^  , 
XN2^"  * *'  xnn^  ' 1 * v < P is  composed  of  independent 
random  variables. 

Let  the  marginal  distribution  function  of  the  entry 
X ^ be  F^  ; 1 * v s p , 1 < i < N . 


i.e. , for  any  x,  — < x < +• 


(3.2.4) 


PMi>  (X)  " P(XNi)  * X) 


We  now  proceed  to  define  the  ranks  for  each  row. 


(v) 


Consider  the  vth  row  (X££ 
,(v) 


For  the 


random  variable  X^  , we  define  its  rank 


■ (Number  of  X^j*  s X^*)  * 1 s v s p . 


(3.2.5) 
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Thus  corresponding  to  the  matrix  X^,  we  have  the 
rank  matrix  defined  by 


(3.2.6) 


5n 


R(1)  R (1) 
Nl  N2 


r!2)  r(2) 

Nl  N2 

R(v)  R(v) 
*111  w2 


(P)  n(P) 
N2 


HZ 


R.(1) 

rTj 

r(2) 

RNj 

R.(V) 


p<P> 

*Nj 


C 


(2) 


R^) 


. . R 


(P) 

NN 


Let  £CN1*'  * * * Cnn^  # 1 * v < P be  p-sets  of 
knc*m  (regression)  constants. 

Let  f , . . . Ajj^ } , 1 s v s P be  p-sets  of 
known  constants  (scores) . 

We  define  the  simple  linear  rank  vector  S„  correspond- 

mN 


ing  to  Xg  by 


(3.2.7)  - (sj1*.  . . .,  S^)'  where 


(3.2.8) 


S 


(v) 


i-1 


We  are  interested  in  the  Asymptotic  normality  of  the 


simple  linear  rank  vector  ■ (S^ 


(1) 


8W)  * 
N 1 
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As  before  we  assume  that  the  scores  are  generated 

by  known  functions  <p  in  either  of  the  following  ways: 


•£'  - E V0*1’’ 


with  the  usual  notation. 


3.3  Main  Results : In  this  section  we  establish  the 

asymptotic  multinormality  of  the  statistic  S defined  by 

(2.7)  and  (2.8).  We  make  the  following  assumptions: 

For  each  v , 1 s v < p , there  exist  constants 

6 >0  and  generic  constants  K such  that 

v 6 -1/2 


(i)  |cpv(t)|  * Kft(l-t)} 


, 0 < t < 1 


6-3/2 

(ii)  |v'(t)|  S K(t  (1-5) ) V , 0 < t < 1 

(iii)  For  each  v,  1 < v * P#  the  empirical  process 
(t)  and  ahe  weighted  empirical  process  (t)  defined 

as  in  chapter  I,  with  covariance  kernels  (s,t)  and 

(s,t)  respectively,  satisfy  conditions  of  theorem 
(1.3.2)  (or  corollary  (1.3.3)). 

We  then  have  the  following  theorem: 
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Theorem  3.3.1: 
above  be  satisfied. 


Let  conditions  (i) , (ii)  and  (iii) 
Let,  in  addition 


(3.3.1) 


max  |c£>| 
liilJ 


0(^)  ; 1 * V * P 


(3.3.2) 


**  « Var  ; 1 < v < P • 


He  have  dropped  the  index  N in  order  not  to  encumber 
our  notation  too  much.  Otherwise,  note  that  s^  depends 
on  N . 

Then,  tot  every  vector  X in  Rp,  has 

asymptotically  a standard  normal  distribution  where  Ujj  and  E^  are 
defined  below; 


(3.3.3) 


. . (1) 


(p),  * 
WN  ) 


(3.3.4) 


>4vl  - ? <=&’  JVh<v><x))  <”&’  <*> 

i-i 


(3.3.5) 


H(v)  (x)  - £ Y Fxl  (x) 


i-1 
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(3.3.6) 


) ■ (s  ) ; 1 s u,v  £ p 

Ajj  UV 


(3.3.7) 


s « Cov  (S^i  S^v^) 
jiV  V N ' N ’ 


As  in  the  univauriate  case,  the  variance-covariance 
Matrix  cam  be  taken  to  consist  of  approximate  variance  - 

covariance  terms,  namely. 


N 


(3,3.8)  »uv-  V COV  r^)(4“>), 


i,k*»l 


where 


(3.3.9)  *&><*>  - J f (C^>  - c£>>  J*{I(xsy)  - f£>  (y) , 


j-1 


x flp^  (H(v)(y))  dF^y) 


Nj 


1 S 4»v  < p 


Proof:  He  use  the  Cr&ner-Wold  criterion:  Let  A^, 


A^  be  fixed  but  aurbitramy  constants.  It 


suffices  to  show  that. 


(3.3.10) 


A .<«  4.  A S<2>  + + A 8<P>  _ rr 

A1SN  + A2SN  + * • • + Vn  UN  # 


i 


77- 


say^  is  asymptotically  normal. 

Observe  that  by  theorem  1.6-lof  chapter  I,  , 

properly  normalized  is  asymptotically  normal.  In  fact,  we 
have  shown  slightly  more.  To  be  more  precise,  we  have 
established  that 


S(v)  - u(v) 
N 


_y(v)}  +^N_ 
YN  > +s(v) 


DW-  I D(V) 
N iN 


<X^>  - V<->,  -2(x(v) 


- Y*v))  and 


Thus, 


N P 


S(V)  - u(v) 

N P ..(v) 

-4  X 


- Y(v)  : 1 * v < p 


which  is  Gaussian  with  mean  0 and  variance  1 . Hence, 


-(v)  (v) 
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which  is  Gaussian.  This  completes  the  proof. 


5(v) 

N 

8 


Computation  of  : As  before,  we  can  disregard  the 

terms  and  express  each  as  the  sum  of  independent 


random  variables. 


(3.3.11) 


s(v)  _ (v)  _ D 

SN  UN  D 


(v) 

N 


f »<V>  ,„(v) 


(XHi  > Where 


i=l 


i (v) 
Ni 


^ (X)  » — V (C 
i 1 1 N / ' Ni 


C„.)  J I(X^}  £ y)  9\hM(Y))  dF^Cy) 


'Nj‘ 


j=l 


Similarly, 


(3.3.12) 


= V (Y^) 

N N L l~Nk  ' 


k-1 


(3.3.13) 


In  view  of  the  fact  D, 


(v) 

N 


o (s  ) , we  have 
P v 


C°V  (8^,  s'v))  •-  suv 


l cov  Wit1  «*>• 


i,k-l 

f 

where  alt  the  cruantitiea  have  already  been  defined. 
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Chapter  IV 

DECOMPOSITIONS  OF  GAUSSIAN  NOISE  s 

4.1  Introduction;  This  chapter  will  be  devoted  to 
an  examination  of  the  phenomenon  of  "Gaussian  Noise". 
Specifically,  the  "noises"  giving  rise  to  two  well-known 
Gaussian  stochastic  processes,  viz,  the  Wiener  process  (or 
Brownian  Motion)  and  the  Borwnian  Bridge  process  (or  the 
Doob-Kac  process)  will  be  studied.  Such  noises  will  be 
obtained  as  the  limits  in  a certain  sense  of  "discrete" 
noises.  A discussion  of  the  phenomenon  of  noise,  particularly 
of  white  noise  can  be  found  in  most  advanced  text  books  on 
stochastic  processes  among  which  Arnold  [2]  , Gel* f and  and 
Vilenkin  [8]  and  Hida  [13]  merit  special  mention.  Hida  in 
particular  gives  an  extensive  treatment  of  white  noise 
unlike  most  other  books,  which  treat  it  in  a cursory  manner. 
Our  discussion  will  differ  somewhat  from  all  these  in  the 
sense  we  view  Gaussian  Noise  as  the  limiting  action  of  a 
simpler  phenomenon.  Rest  of  this  section  will  be  devoted 
to  a brief  description  of  noise,  using  white  noise  as  example. 

White  noise  is  understood  in  the  applied  sciences  to  be 
a stationary  Gaussian  process  {{(t)  : 0<t<+«)  with 
eovsriance  kernel 

4.1.1)  C(t)  - EC?(s)|(s+t)  3 , E §(t)  - 0 


i 
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and  having  a constant  "spectral  intensity" 

(4.1.2)  f (X)  = /*  C(t)  e"Utdt  = 

where  'a'  is  a constant.  Thus  in  the  spectrum  of  such  a 
process,  all  the  frequencies  participate  at  the  same  intensity 
just  as  in  the  case  of  the  spectrum  of  white  light.  Hence 
the  name  white  noise.  But  the  identity  (4.1.2)  is  compatible 
only  when  C(t)  is  the  so  called  Dirac  "delta  function" 
and  such  a process  does  not  exist  in  the  usual  sense  of  a 
stochastic  process.  But  ?(t)  does  arise  in  physical 
problems  in  the  following  manner: 

Let  X (t)  be  the  state  of  a physical  system  at  time 
t . It  often  arises  as  the  solution  of  a differential 
equation  of  the  type 

(4.1.3)  d X (t) ■ f(t,  X(t)dt  + G(t,X(t)dW(t) 

- f (t,X(t)  )dt  +G(t,X(t))?(t)dt 

where  W(t)  is  the  Wiener  process.  Recall  that  the  Wiener 
process  W(t)  is  a Gaussian  process  with  EW(t)  £ 0 and 
K(s, t)  * E(X(s)X(t) ) « min(s,t).  In  this  sense  white  noise 
is  often  interpreted  as  the  "derivative"  of  the  Wiener 
process.  However,  since  the  sample  paths  of  the  Wiener 
process  are  nowhere  differentiable  with  probability  1,  we  are 
again  left  with  the  conclusion  that  {(t)  does  net  exist  as 
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i 


a stochastic  process,  it  should  be  noted  that  the  choice  of 
the  Wiener  process  (and  of  white  noise)  in  equations  of 
the  type  (4.13)  is  largely  one  of  mathematical  expediency  and 
often  physically  unrealistic.  The  definition  of  white  noise 
can  be  made  rigorous  in  the  following  manner: 

Let  S denote  the  space  of  all  infinitely  differentiable 
function  cp(t)  , t a 0 with  compact  support.  That  is,  for 
each  cp  € S , there  is  a compact  set  IC.  , n ■ 0,1,...  such 

M , Cp 

that  t^K  ^ entails  cp(n)  (t)  =0,  n = 0,1,...  . We 

n,  cp 

topologize  S in  the  following  manner.  A sequence  (cpn) 
in  S is  said  to  converge  to  a function  cp  in  S if 
(cp  , cpnJ  vanish  outside  the  same  compact  set  K and 

(4.14)  lim  { max|cp*[k)(t)  - cp_fkU) } - 0 ; k - 0,1,2,...  . 

n-H-oo  t n 

Definition  : Let  A : S -*  R^  be  a continuous  linear 

functional.  Then  A is  called  a "distribution"  or  a 
"generalized  function"  in  S . 

Definition  : Let  A be  a generalized  function  on  S . 

Then  its  "distributional  derivative"  (generalized  derivative) 
is  the  map 


(4.1.5)  A'cp  *-Acp/ 

Definition  : A "generalized  stochastic  process"  is 

a stochastic  process  ($(cp)  s cp  € SI  in  the  following  sense: 
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(i) 

Yep  € S , 

* (cp) 

is  a 

random  variable 

(ii) 

H 

Ml 

% 

CP2  € s 

and 

al'a2  arbitrary  constants. 

* (a^cpj^  + a2cp2  ^ = ai*(cPi)  +a2*(cp2) 

with  probability  1 . 

(iii)  If  cpJcn  '*«Pjc»  k = l,...#m  in  S , then  the 
random  vector 

(*<<pln),,*,#*(cpmn)  * "*  (* (cpx)  »•••»* (cpm) ) 
in  distribution. 

We  shall  now  define  a simple  transformation  which 
enables  us  to  obtain  W(t)  and  $(t)  as  generalized 
stochastic  processes.  We  first  need  the  following 
definitions. 

Definition  s A real-valued  function  f on  [0,«)  is 
said  to  be  "locally  integrable"  if 

(4.1.6)  Jk|f(x)|d  x < + • 

for  every  contact  set  K . 

Observe  that  every  locally  integrable  function  f 
defines  a generalized  function  on  S whose  "action" 

is  given  by  , < Af#(  • ) > where 


(4.1.7)  <Af  , cp>  - (Af)  (cp)  - f (t)cp(t)dt 
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Henceforth  we  shall  find  it  convenient  to  use  the 
symbol  < A#  (•)>  to  mean  A(0  . 

Definition  : The  "derivative"  of  a locally  integrable 

function  f is  defined  to  the  distributional  derivative 
Af  . That  is  to  say  , 

(4.1.8)  <A'f  , q>>  — <Af,cp'>  * -jV  (t)  f (t)dt  . 

0 

Let  W ( t)  be  the  Wiener  process.  Then  the  "Generalized 
Wiener  Process"  (W(cp)  : cp  € S}  is  obtained  by  the  trans- 
formation, 

(4.1.9)  <AW  , cp>  * W(cp)  * J"  cp(t)W(t)dt  . 

0 

Definition  : The  white  noise  £ is  defined  to  be  the 

distributional  derivative  of  the  generalized  Wiener  process 
defined  by  (4.19).  That  is  to  say,  its  action  A?  is 
given  by  , 

(4.1.10)  <A|  , q>>  - <A'W,cp>  - <AW,cp'> 

- - /•  W(t)q,'(t)dt  . 

0 

Observe  that  (4.1.10)  does  not  permit  us  to  view  white 
noise  as  a random  function  since  Af  is  not  a function  but 
a generalized  function.  But  A(  does  exist  as  a generalized 
stochastic  process.  This  fact  as  well  as  many  of  the 
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properties  of  A?  can  be  found  in  Gel'fand  and  Vilenkin 
[8]  . Hence  we  will  not  go  into  these  matters  but  restrict 
ourselves  to  the  following  remarks. 

The  transformations  A and  A'  have  in  effect 
resulted  in  "smoothing"  W and  { . Thus  we  are  in  a 
position  to  discuss  their  differentiability  properties.  But 
this  has  been  obtained  at  a certain  preice  as  we  have  lost 
sight  of  the  time  parameter  t as  well  as  the  sample  path 
descriptions  of  W(t)  . One  often  views  a stochastic 
process  as  the  state  of  a system  as  it  evolves  in  time. 

Many  of  the  most  important  properties  of  stochastic  properties, 
such  as  for  example  the  Markov  property  make  explicit  use  of 
this  concept.  Thus  a descritpion  of  the  sample  paths  is 
well  nigh  indispensible  for  any  analysis  of  stochastic 
processes.  This  undoubtedly  accounts  for  the  fact  that 
inppite  of  their  desirable  analytical  properties,  generalized 
random  functions  have  not  found  extensive  use  in  the  study 
of  stochastic  differential  equations. 

In  the  next  section  we  will  introduce  a family  of 
random  transformations  of  the  type  (4.1.7)  in  an  attempt  to 
incorporate  some  of  the  advantages  of  generalized  random 
functions  without  losing  the  sample  path  characteristics. 

A consequence  of  this  will  be  a central  limit  theorem  for 
white  noise  analogous  to  the  Donsker  theorem  for  random 
walks.  Then  we  will  obtain  a different  but  equivalent 
description  of  white  noise.  In  section  3,  we  apply  the  same 
methods  to  the  noise  giving  rise  to  the  Brownian  Bridge 
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process.  This  in  turn  yields  a rather  remarkable  connection 
between  the  projection  techniques  of  Chernoff  and  Savage 
(used  by  us  in  Chapter  II)  and  a canonical  approximation 
for  Gaussian  noise. 

4.2  Approximations  of  White  Noise  : 

Henceforth  we  shall  restrict  ourselves  to  the  set 
T ■ [0,1]  which  is  compact.  Then  the  space  S becomes  the 
space  of  all  infinitely  differentiable  functions  on  T . 

At  the  endpoints  of  T , we  take  one-sided  derivatives. 

Let  3 be  the  class  of  all  bounded  measurable  functions 
on  T . Observe  that  since  T is  compact,  every  f in  3 
is  Lebesgue  integrable. 

For  each  f in  3 , we  define  a map  Af  on  S x T 
given  by 

(4.2.1)  (q>, t)  -»  j‘tf(s)q)(s)ds  . 

0 

We  shall  use  the  sumbols  <Atf,cp>  and  (Af,qp>(t) 
equivalently  to  mean, 

(4.2.2)  <Afcf,cp>  - < Af  , 5p>  (t)  - f%>(s)f(s)ds  . 

c 0 

With  the  operator  A we  associate  its  "differential" 


operator  A whose  action  is  given  by 


# 


« IffHBfnU  1 <11 


I 


I 
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(4.2.3)  <Afcf  , cp>  - < Af  , <p>  (t) 

■ cp(t)f(t)  - rfcf  (s) cp7  (s)ds  . 

0 

Since  [0,t]c[0,l3  is  compact  and  since  f is 
bounded,  the  linearity  and  continuity  of  Afcf  are  immediate. 
Thus  Afcf  is  a generalized  function  on  S for  each  t 
and  f . 

Remark  : If  we  take  T = [(),•)  as  before  then  require 

«p  to  have  compact  support,  the  definition  (4.23)  coincides 
with  the  definition  of  the  distributional  derivative  of 
Af  given  in  the  preceding  section.  (Because,  f is  bounded, 
support  of  (p  is  compact  and  hence, 

lim  (cp(t)f(t)  - Jtf  (s)cp' (s)ds)  * -/"f  (s)  cp' (s)  ds 
t-»+*  0 0 

- <A'f,cp»  . 

Let  {X(t)  s 0<t<l]  be  a stochastic  process  which 
is  integrable  in  t . Then 

(4.2.4)  <A*X,{p>  - < AX,cp>  (t)  - X ( s)  cp(s) ds 

0 

is  also  a stochastic  process. 

Let  the  sample  paths  of  X(t)  be  bounded  measurable 
functions.  This  includes  the  space  C[0,1]  and  D[0,1] 
and  thus  covers  most  cases  of  interest.  Then  the  "derivative” 
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of  X(t)  is  defined  by 

(4.2.5)  <V  X, «p)  * <AX  , flp>(t)  = cp(t)X(t)  - 1%'  (s)X(s)ds 
z 0 

and  is  also  a stochastic  process.  Thus  our  definition  has 
the  advantage  that  with  reasonable  sample  path  restrictions, 
stochastic  processes  are  closed  under  differentiation. 

Let  f W(t)  : Oitil)  be  the  Wiener  process.  Then 

• 

(4.2.4)  (AW,cp)(t)  ■ f*W(s)  cp(s)ds  . 

0 

* 

We  define  white  noise  by  the  operator  A{  * AW  whose 
"action"  is  given  by 

(4.2.7)  <A«,q>Xt)  = <AW,cp)  (t) 

• cp(t)W(t)  <p'(s)w(s)ds  . 

Again  if  we  let  t -*  +•  , with  the  usual  restrictions  on 
«p  , the  definition  (4.2.7)  coincides  with  that  given  for 
white  noise  in  (4.1.10)  in  the  preceding  section. 

Physically  we  can  interpret  (4.2.7)  as  the  "resultant" 
state  of  a system  (or  a measuring  devicS)  whose  character 
(such  as  friction)  is  given  by  the  function  <?  , when  acted 
upon  for  a period  t by  an  external  source  of  white  noise. 
Observe  that  the  families  ( AfcW  ; Oitil)  and 


i 


4 


88- 


{ At5  : 0 i t s 1}  are  not  stochastic  processes  but  act  on 
the  function  space  S to  generate  families  of  stochastic 
processes  < AfcW  , cp>  and  < , cp>  , cp  € S . For  each 

particular  cp  , we  have  a stochastic  process;  for  each  fixed 
t , we  have  a generalized  stochastic  process  over  S . 

Next  we  turn  our  attention  to  "discrete"  processes. 

Let  . . . #Yn,  . . . , be  independent,  identically 

distributed  random  variables.  Without  loss  of  generality 
we  assume 


E Yi  = 0 , Var  Yt  = 1 . 

We  define  the  discrete  process  (X^ft)  ; 0 s t £ It 
corresponding  to  the  sequence  {Y^}  by 

1 Cnt3 

(4.2.8)  X^Ct)  - ^ Yi 

where  [a]  is  the  greatest  integer  s a . 

It  is  well  known  that  Xn(t)  is  realizable  in  the 
function  space  D[0,1]  (or  sinqply  D ) defined  as 

Definition;  D is  the  class  of  all  functions  x(t)  , 
0 st  si  t such  that  x(t“)  and  x(t+)  exist  for  all 
0 < t < 1 and  x(t)  « x(t+)  . Further, 

(4.2.9)  x(0)  - x(0+)  and  x(l)  - x(l-)  . 
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For  any  two  functions  x and  y in  D , we  define 
the  metric  p where 

(4.2.10)  p(x,y)  = max  |x(t)  - y(t) I 

Ostsl 

Definition  : We  now  define  the  operator  Atxn  by 

its  action  S , viz, 

(4.2.11)  <AtXn.cp>  - <AXn,cp>(t)  * J%(s)Xn(s)ds  . 

Definition  : We  define  the  "discrete  noise"  t 

*n 

corresponding  to  the  process  ( t)  (or  the  sequence 

(YkJ  ) by  its  action, 

(4.2.12)  <At?n»«P>  - <A?n,cp>  (t) 

- <AXR,cp>(t)  * cp(t)Xn(t)  - J*Sp'  (s)  ^(s)ds  . 

Remark  s Observe  that  the  processes  <AfcXn,cp)  and 
(Atln#cp>  are  also  realized  in  D[0,1]  . Again  we  note  that 

A 

AfcXn  and  AtXR  • At5n  aro  not  Processes  the  conventional 

sense. 

We  next  examine  the  limiting  behaviour  of  (n  . 

Theorem  4.2.1  t Let  (Y^J  be  independent,  identically 
distributed  random  variables  with  mean  0 and  variance  1 . 
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Let  X_ (t)  and  E . be  as  defined.  Then  there  exists  a 
n n — — 1 ~ 1 1 ■ 

sequence  [ f n)  of  discrete  noises  on  the  same  probability 
space  whose  action  <Afc5n,cp>  has  the  same  distribution  as 
the  action  (At§n,cp)  of  and  converge  weakly  to  the 

action  of  a white  noise  on  the  same  probability  space. 

Proof  : For  weak  convergence  of  stochastic  processes 

we  need  to  prove  two  things:  convergence  of  the  finite 

dimensional  distributions  and  the  convergence  of  sample 
paths.  We  shall  follow  section  13.4  of  Breirnan  [4]  . 

First  we  shall  establish  the  continuity  of 

A 

<Afc  • »cp>  on  D[0,1]  for  (t,cp)  € [0,1]  X S . 

Recall  that,  Vx  € D , 

<A«.x,cp>  = x(t)cp(t)  - f fcx ( s ) cp'  (s)  ds  . 

* 0 

Let  x and  y be  elements  in  D . Then 

(4.2.13)  |<Atx,cp>  - <Aty,up>| 

■ | cp(t)  (x(t)-y(t))  - J‘t  (x(s)-y(s))cp'  (s)ds| 

0 • 

< |x(t)  - y(t)  | |cp(t)  J +J‘t|x(s)  -y(s)  | \q>'  (s)  )ds  . 

0 

Let  M ■ max  {max  |cp(t)|,  max  |<p'(t)}  . 

Oetel  Oetel 


Then  in  (4.2.13) 


|<A«.x,cp>  - <A.y,cp>|  «M(max  |x  (s)  - y (s)  | +1  max  |x(s)-y(s)J) 
c t Ossst  Ossst 

* M2p(x,y)  . 

Thus,  given  e>0  , choose  6 • Then  , p(x,y)  <6 

(4.2.14)  l<Atx,cp>  - <Aty,cp>l<  e . 

A 

Thus  <At  • • cp>  is  continuous  on  D[0,1]  . 

By  theorem  1.3.8  Breiman  [4],  there  exists  a process 
Xn(t)  having  the  same  distribution  as  Xn(t)  and  a Wiener 
process  W(t)  all  on  the  same  probability  space  such  that 
for  any  subsequence  { n^)  increasing  rapidly  enough, 

sup  |X  . ( t)  — W(t)  | -»  0 a. s. 

Ostsl'  ** 

M 

Let  be  the  noise  corresponding  to  Xn(t)  • Since 

X (t)  and  X (t)  have  the  same  distribution,  it  is  obvious 
n n 

that  <Atxn,cp)  - < At$n»cp)  and  <Atxn»cp>  * (A^n?)  have 
the  same  distribution. 

Next  let  b«  the  subsequence  corresponding  to 

a rapidly  increasing  sequence  (n^}  . Then 

sup  | <A|  k,«p>  (t)  - <Af  #q>>  (t)  ) 

CUtsl 


(4.2.15) 
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- sup  |cp(t)X.(t)  - rV(s)X.  (s)ds-(Cp(t)W(t)-rtcp/(s)W(s)ds)  | 
Ost*l  nK  Q nK  0 


i sup  |cp(t)  (X  . (t)  -W(t))  |+  sup  | Ptcp/  (s)  (X  . (s)-W(s))dsl 
Ostsl  nK  Ostsl  0 nK 

a.s.  , 

Since  p (x  .,W)  -»  0 a.s.  and  max  |cp(t)|s  M, 

Ostsl 

max  | cp'  (t)  | « M . 

Ostsl 

Next,  let  5nJc  be  any  subsequence  of  ?n  . We  can 
extract  a further  subsequence  §nk  , such  that  {n£}  is 
a subsequence  of  and  is  increasing  rapidly  enough 

for  (4.2.15)  to  hold.  Hence,  we  have 

(4.2.16)  sup  UML.cpXt)  - <H,cp)(t)  | 4 0 a.s. 

Ostsl 

\ 

| of  course  is  the  white  noise  corresponding  to  the 
Wiener  process  W(t)  . 

Convergence  of  the  finite  dimensional  distributions  is 
an  immediate  consequence  of  (4.2.16)  since  a.s.  convergence 
is  much  stronger.  This  proves  the  theorem. 

Remark  : Observe  that  on  taking  cp  to  be  a nonzero 

constant  function,  a 0 and  we  get  Donsker's  theorem  on 

the  convergence  of  random  walks  to  the  Brownian  motion. 
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We  shall  now  obtain  a simple  approximation  for  the 

action  of  the  discrete  noise  C and  thus  for  white  noise. 

*n 

Observe  that  the  process  Xn(t)  has  "jumps"  of 

1 J • 

at  the  points  tr  » ~ • •••»“•  Thus  we  can  define  the 

n n n 

Stieltjes'  integral 


(4.2.17) 


. . [nt]  4 

“ 7T  £ Yi 


Summation  by  parts  yields. 


<4-2-18'  i lXi  tp("IYi " Yi 

■ -ft**  - X*  • 

Using  the  Mean  Value  theorem,  n * ai  * ^n^  * t*le 
right  hand  side  of  the  expression  can  be  written. 


[nt] 


(4.2.19)  Xn(t)  -j‘3(*'(«1>|)  I V,) 


k q»(t)Xn(t)  - J%'(t)Xn(s)ds 


approximately . 


[nt] 


Thus  A £ epC-jJY^  an  approximation  for  the  action 
(AtCn»<P)  and  hence  also  for  the  action  (AtC*«p)  of  white 


noise. 
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In  the  next  section,  we  shall  obtain  a different 
approximation. 

4.3  Noise  Corresponding  to  Empirical  Processes t 

In  this  section  we  will  define  a noise  phenomenon 
giving  rise  to  empirical  processes.  From  that  we  shall  give 
an  approximation  for  the  action  of  "Brownian  Bridge  Noise" 
and  hence  also  for  white  noise. 

Recall  that  a "Brownian  Bridge”  (W°(t) t 0 * t a 1}  is 
a Gaussian  process  with  mean  0 and  covariance  kernel 

(4.3.1)  R(s,t)  - Cov(W°(s),W°(t))  - min(s,  t)  - st  . 

Let  ui'u2* • * • »un* • • * independent  identically 
distributed  random  variables,  distributed  uniformly  over 
[0,13.  That  is  to  say 

(4.3.2)  P^ct)  - t , Octal  . 

We  define  the  "Empirical  process"  (Yn(t)  x Octal} 
corresponding  to  the  set  {u^,^, . . . ,un)  by 

(4.3.3)  Yn(t)  * 

where  I (U^  4 t)  is  called  the  indicator  random  variable 
given  by  , 
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(4.3.4) 


I (U£  < t) 


1 # U^t 
0 , otherwise 


It  is  well  known  that  the  process  YR(t)  converges 

weakly  to  W°(t)  in  D[0,1]  • 

As  before  we  define  the  operators  A. Y and  A . W° 

t n t 

by  their  actions  on  S , vis. 


(4.3.5)  <AtYn.flP>  - <AYn.<p>(t)  - J%(s) Yft(s) ds 

(4.3.6)  <At"°,«>>  - <AW°,<p)(t)  - <p<s)W°(s)ds  . 

0 


This  enables  us  to  define  the  corresponding  noises, 
AfcYn  ■ Afcf®  and  AfcW°  ■ At?°  which  we  shall  respectively 
call  "indicator  Noise"  and  "Bridge  Noise".  Their  actions 
are  given  by. 


(4.3.7)  - (A^n'*)  " »(t)Yn(t)  - jV  (a)  Yn(s)ds 

(4.3.8)  <AtW°,*>  - <Atf°,«p>  - <p(t)W°(t)  -jV(s)Yn(s)ds. 


A convergence  theorem  for  AtYn  , analogous  to  theorem 
(4.2.1)  can  be  proved.  However,  we  shall  simply  obtain  an 
approximation. 

Observe  that  YR(t)  has  jumps  of  at  the  random 
points  t - ui'u2»***»un*  Thu*  w*  can  write  the 
Stieltjes'  integral. 
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* l Cnt] 

(4.3.9)  J*  <p(s)dY(s)  - -rr-  £ cp(u, ) 

0 i-1  1 

where  we  have  assumed  without  loss  of  generality,  that 
u^  < u2  < . . . < uR  . 

Again,  summation  by  parts  yields  as  before  the 
approximate  identity* 

(4.3.10)  <A|°  . «p)(t)  - e(t)Yft(t)  - /V(s)Yn(s)ds 

* i , . 

* i-i  * Ui>  ' 

Thus,  we  can  use  (4.3.10)  as  an  approximation  for  the 
action  of  indicator  noise  and  hence  for  the  action  of 
bridge  noise. 

In  this  sense  the  action  of  A(°  can  be  regarded  as 
the  limiting  action  of  an  average  of  "Aandom  Dirac  Measures11. 

■amt  consider  the  discrete  process  X^t)  considered 
in  the  lsst  section.  Zt  is  well  known  that  the  process 
X^t)  - tx^l)  also  converges  weakly  to  the  brownian  bridge. 
Formally  ws  can  say  that  the  actions  of  “measures" 
dxn(t)  - XR(l)dt  and  drB(t)  are  equivalent,  by  which  we 
mean  the  actions  of  the  corresponding  noise  operators  are 
equivalent  in  distribution.  Further,  lot  us  suppose  that 
the  process  ZB(t)  is  constructed  from  the  sans  sequence 
(U^)  as  the  process  Y#(t)  • Then  the  action  of  the 
discrete  noise  l„  and  that  of  white  noise  can  be 
approximated  by. 
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(4.3.10)  Jfc  op(s) dY  (t)  - X (1)  q>(s)ds 
0 0 

1 Cnt3 

■ -jr  £ *<V  - V1'  !>(■>«• 

t 

which  is  again  the  weighted  average  of  random  Dirac  measures. 

Remark  : Integrals  of  the  type  (4.3.10)  appear 

frequently  in  the  asymptotic  theory  of  rank  statistics  for 

t 

example  in  the  proof  of  the  Chernoff -Savage  theorem  (also 
in  our  proof  of  theorem  2.2.1).  Thus  the  asymptotic 
normality  of  linear  rank  statistics  can  be  viewed  as  the 
result  of  the  action  of  indicator  noises  of  various  types. 

i 


i 


| 

* 

?■  \ 
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